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performance  Indlcles  do  not  conflict  with  each  other.  In  oartlcular,  we 
have  defined  the  notion  of  noninteraction  for  Quadratic  cost  functionals 
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problem.  In  this  framework,  we  have  developed  necessary  conditions  for 
existence  of  an  optimal  decentralized  control  law,  derived  two  numerical 
algorithms  for  the  computation  of  the  optimal  decentralized  control,  and 
proved  the  convergence  of  the  decentralized  algorithm  under  suitable 
conditions.  Finally,  convergence  characteristics  of  the  two  algorithms 
are  compared  using  a  tenth  order  model  of  a  jet  aircraft  examole  Involving 
the  joint  design  of  flight  and  engine  control  subsystems. 
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Executive  Sunnary 


The  purpose  of  this  study  is  to  develop  a  computational  technique  for  designing 
various  subsysten  controllers  of  a  physical  systen  in  a  coordinated  nanner.  e.g.  the 
design  of  engine  and  flight  control  subsysten  controllers  on  an  aircraft.  In  a 
coordinated  design,  the  controllers  are  designed  jointly  so  that  the  designed 
subsystems  cooperate  with  each  other,  thus,  nimnizmg  potential  subsysten 
interactions  which  can  lead  to  performance  degradation  such  as  increased  fuel 
expenditure 

The  najor  results  of  our  study  are  as  follows.  First,  we  have  found  conditions  01. 
the  subsysten  controller  objectives  guaranteeing  the  non-interaction  between  these 
performance  indices.  Second,  we  have  fornulated  the  design  as  a  constrained  output 
feedback  problem  and  found  sufficient  conditions  which  guarantee  the  existence  of  an 
optinal  control  law  The  inportance  of  these  conditions  is  that  the  existence  of  a 
solution  can  be  determined  at  the  outset  of  the  design  process  fron  the  known 
subsysten  and  objective  function  parameters. 

Next,  we  have  developed  an  iterative  numerical  algorithm  for  computing  the 
optimal  control  law  and  proved  that  that  algorithm  converges  to  an  optimal  solution 
under  the  sufficiency  conditions  ensuring  the  existence  of  an  optimal  solution  This 
convergence  results  is  important  since  the  sufficiency  conditions  include  a  large  class 
of  practical  design  problems 

Finally,  the  developed  algorithm  is  used  to  design  an  integrated  flight  and  engine 
control  system  based  on  the  tenth  order  linearized  longitudinal  dynamics  of  a  fighter 
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1.  INTRODUCTION 


This  basic  research  study  has  been  concerned  with  the  investigation  of 
coordinated  control  systems  design  for  improved  fuel  efficiency.  Be  believe  that  the 
coordinated  control  algorithm  developed  here  would  be  useful  not  only  in  improving 
fuel  efficiency,  but  also  in  optimising  the  coordination  between  the  various  control 
systems  on  a  given  aircraft  for  improved  system  performance. 

Coordinated  control  encompasses  the  general  problem  of  control  subsystems 
design,  in  which  controllers  corresponding  to  different  subsystems  work  in 
coordination  with  each  other.  In  these  systems,  there  are  a  multiple  number  of 
control  subsystems,  each  with  a  different  control  objective  and  each  with  a  different 
controller  structure  driven  by  a  different  subset  of  the  plant  measurements.  In  a 
coordinated  design,  controller  performance  objectives  ar  jointly  optimised  over  the 
parameters  of  their  structures  so  that  the  designed  subsystems  cooperate  with  each 
other  Thus,  potential  interactions  between  subsystems  which  can  lead  to  performance 
degradation  (such  as  increased  fuel  expenditure)  are  eliminated  in  a  coordinated 
design 

The  problem  of  control  subsystems  design,  in  which  controllers  corresponding  to 
different  subsystems  work  m  coordination  with  each  other,  falls  into  the  general  area 
of  decentralised  control  In  our  study,  we  have  considered  the  following  class  of 
decentralised  control  problems.  The  plant  dynamics  are  described  by  a  linear 
discrete -time  stochastic  time -invariant  system.  There  are  a  multiple  number  of 
control  subsystems,  each  with  a  different  control  objective  and  each  with  a  different 
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linear  noisy  measurement  subset  of  the  plant  state.  The  controller  objective  of  each 
subsystem  is  modelled  by  a  quadratic  cost  functional.  Moreover,  the  complexity  of 
each  control  subsystem  is  constrained  such  that  each  controller  is  restricted  to  be  a 
linear  dynamic  system  driven  by  the  measurements  available  to  that  controller. 

Our  study  has  two  major  thrusts.  The  first  one  is  concerned  with  the  selection 
of  different  controller  cost  functisnals  such  that  these  performance  indices  do  not 
conflict  with  each  other.  In  particular,  we  have  defined  the  notion  of  noninteraction 
for  quadratic  cost  functionals  and  found  necessary  and  sufficient  conditions  for 
noninteraction  between  quadratic  costs 

The  second  major  effort  of  our  study  is  the  formulation  of  the  decentralized 
control  design  as  a  constrained  optimal  output  feedback  problem.  In  this  framework, 
we  have  developed  sufficient  conditions  tor  the  existence  of  an  optimal  decentralized 
control  law.  derived  two  numerical  algorithms  for  the  computation  of  the  optimal 
decentralized  control,  and  proved  the  convergence  of  the  decentralized  algorithm 
under  suitable  conditions  Finally,  convergence  characteristics  of  the  two  algorithms 
are  compared  using  a  tenth  order  model  of  a  jet  aircraft  example  involving  the  joint 
design  of  flight  and  engine  control  subsystems 

The  developed  coordinated  control  algorithms  are  applicable  to  quite  a  number  of 
relevant  problems  in  the  context  of  aircraft  control  For  instance,  the  proposed 
formulation  encompasses  the  following  types  of  control  subsystems  design  problems 
simultaneous  design  of  a  structure  mode  control  system  (|&)-(16)  and  a  stability 
augmentation  system  (SA$)  |u).  joint  design  of  an  autothrottle  [20]  and  as  altitude- 
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hold  system;  joint  consideration  of  a  SAS  design  and  pilot  dynamics.  In  fact,  all 
control  subsystems  on  a  given  aircraft  can  be  considered  simultaneously  within  the 
scope  of  the  proposed  study.  Furthermore,  the  proposed  formulation  can  handle  the 
problem  of  designing  different  control  loops  in  a  given  aircraft  control  subsystem.  For 
instance,  the  problem  of  joint  design  of  pitch  [18],  roll  and  yaw  [19]  control  loops  in  a 
given  SAS  can  be  resolved  within  this  framework. 

We  believe  that  the  decentralized  control  law  algorithms  which  we  have  developed 
here  make  an  important  contribution  to  decentralized  control.  As  remarked  by 
Sandell,  et.al.  in  [22]:  "Perhaps  if  our  insistence  that  the  solution  be  optimal  with 
respect  to  the  very  wide  class  of  all  functions  of  past  observations  is  relaxed,  a 
solution  that  is  computable,  implementable,  and  robust  can  be  obtained".  That  is, 
fixed  controller  structure  approach  taken  in  our  study  is  certainly  feasible  and  may 
well  be  the  appropriate  extension  of  the  LQG  methodology  to  decentralized  control.  It 
is  precisely  this  goal  of  developing  decentralized  control  laws  which  are  computable, 
implementable.  robust  and,  of  course,  stable,  and  perform  their  objective  satisfactorily 
that  our  study  addresses. 

The  organization  of  the  report  is  as  follows:  background  information  about 
aircraft  fuel  efficiency  is  given  in  the  next  section.  Section  1.2  contains  a  specific 
example  showing  the  potential  performance  degradation  which  can  occur  when 
subsystem  controllers  do  not  cooperate  with  each  other.  Technical  results  are 
presented  in  Chapter  2.  An  overview  of  decentralized  control  theory  aspects  having 
the  most  relevance  on  cooperating  control  subsystems  design  is  given  in  Section  2.1. 
The  mathematical  description  of  the  class  of  problems  considered  in  our  study  is 
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developed  in  Section  2.2.  Sections  2.3- 2. 5  contain  the  results  for  nonconflicting 
nultiple  quadratic  cost  functional  selection.  A  constrained  output  feedback  problem 
equivalent  to  the  posed  decentralized  control  problem  is  given  in  Section  2.6.  Section 
2.7  contains  the  existence  results  for  the  optimal  decentralized  control.  Incremental 
cost  and  necessary  conditions  of  optimality  are  given  in  the  next  section.  Section  2.9 
contains  the  numerical  algorithms  for  the  computation  of  the  optimal  decentralized 
control  law.  Convergence  results  are  presented  in  the  npxt  section.  Simulation 
results  for  an  example  problem  concerning  the  integrated  design  of  an  engine  and 
flight  path  control  subsystems  using  the  developed  algorithms  are  given  in  the  first 
section  of  Chapter  3.  The  relevance  of  using  nonlinear  decentralized  control  laws  for 
this  example  is  discussed  in  the  next  section.  Finally.  Chapter  4  contains  the 
conclusions  and  recommendations  for  future  study. 

For  a  quick  overview  of  the  report,  we  recommend  that  the  reader  ret.,!  Sections 
1.1,  1.2,  2.1,  2.2,  introductory  paragraphs  of  Sections  2.3,  2.6,  2.7,  2.6,  2.9,  and  2.10, 
and  Chapters  3  and  4.  Sections  1.1  and  1.2  may  be  skipped  if  motivation  for  the 
problem  is  not  needed.  Similarly,  Sections  2.1  and  2.2  may  oe  skipped  if  the  reader  is 
familiar  with  prior  work  in  this  area 

1.1  Background 

Escalating  costs  of  fuel  during  the  last  decade  have  made  it  mandatory  that  the 
aerospace  industry  should  strive  to  develop  feasible  means  for  fuel  conservation  (l]. 
Motivated  by  the  incentives  associated  with  reduced  fuel  consumption,  such  as 
increased  profit  margins,  commercial  airlines  have  developed  computerized  flight 
planning  systems  to  optimize  direct  operating  costs  (2).  Those  computerized  flight 


planning  systems  are  used  to  find,  for  a  given  departure  and  destination  pair,  the 
necessary  minimum  fuel,  the  optimum  flight  path  checkpoint  sequence,  the  optimum 
flight  altitude  and  speed  for  given  takeoff  gross  weight,  atmospheric  wind,  and 
temperature  conditions.  The  minimum  fuel  computations  are  important  since 
approximately  one-tenth  of  the  extra  fuel  carried  on  a  medium  distance  flight  is 
wasted  to  carry  this  extra  fuel.  Since  the  fuel  considerations  usually  dictate  a  lower 
airspeed  and.  hence,  increased  trip  time,  the  commercial  carriers  usually  opt  to 
minimize  total  direct  operating  costs  which  include  personnel  expenses  in  addition  to 
fuel  expenditure.  Optimum  flight  altitude  profile  is  implemented  as  a  sequence  of  step 
changes  in  altitude  during  cruise  within  the  ATC  constraints.  These  flight  planning 
systems  are  based  on  dynamic  programming  optimization  techniques,  and  utilize  the 
aircraft  performance  data  tables  and  standard  operating  procedures,  such  as  constant 
Mach  or  Long  Range  Cruise. 

Aircraft  manufacturers  have  also  started  to  look  at  the  practicality  of 
implementing  closed-loop  energy  management  systems  for  jet  transports  (3]  These 
efforts  involve  on-board  computation  of  a  best  energy  operating  state  and  the 
execution  of  autopilot  and  autothrottle  commands  to  achieve  this  performance.  These 
methods  are  based  on  the  results  achieved  through  mostly  government-supported 
research  over  the  last  two  decades  [4]-[ll].  In  most  of  these  schemes,  aircraft  point 
mass  equations  of  motion  are  utilized  to  compute  the  optimum  flight  trajectory  using 
numerical  optimization  methods.  Since  the  direct  approach  usually  involves  time 
consuming  iterative  procedures  such  as  steepest  descent,  quasihnearization,  etc., 
simplified  criterion  such  as  specific  energy  state  is  used  for  minimization. 


5 


Specific  energy  state  is  the  sun  of  the  aircraft  kinetic  and  potential  energies 
divided  by  the  aircraft  weight.  For  instance,  an  optimal  climb  profile  is  obtained  by 
maximizing  the  rate  of  change  of  specific  energy  per  unit  fuel  weight  [6).  Although 
the  closed-loop  optimization  technique  for  climb  and  descent  was  determined 
infeasible  for  current  commercial  transports  [3],  a  new  closed-loop  cruise  algorithm, 
used  in  conjunction  with  an  airspeed-hold-mode  autothrottle  and  an  altitude-hold- 
mode  autopilot,  was  proven  to  be  feasible.  Since  a  fuel  savings  of  about  3%  over 
conventional  cruise  procedures  is  possible  with  these  new  cruise  algorithms,  they  will 
certainly  be  implemented  in  the  next  generation  commercial  aircraft. 

For  military  aircraft,  fuel  efficiency  is  desired  not  only  to  reduce  operational 
costs  but  also  to  obtain  increased  mission  range,  heavier  payload  capability  for  a 
specific  aircraft,  and  more  training  missions  for  a  given  fuel  budget  [12]— [13].  Since 
the  current  annual  fuel  usage  of  the  U.S.  Air  Force  is  approximately  4  billion  gallons 
[13],  even  a  one-percent  savings  in  the  fuel  consumption  would  provide  a  substantial 
benefit  to  the  Air  Force. 

We  believe  that  the  flight  path  optimization  theory  is  adequately  developed.  The 
current  state-of-the-art  provides  an  adequate  basis  for  the  industry  to  proceed  with 
the  implementation  of  these  concepts  [3]  The  potential  benefit  to  fuel  efficiency 
which  can  be  derived  from  the  coordination  of  various  aircraft  control  system  designs 
have  not  been  explored.  In  the  next  section,  we  will  give  a  specific  example 
highlighting  an  u  fsirable  interaction  between  two  control  subsystems. 


1.2  Two  Uncooperating  Subsystems  —  An  Example 
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The  commonly  used  approach  of  designing  aircraft  control  subsystems 
independently  from  each  other  can  result  in  an  overall  system  where  the  subsystems 
do  not  cooperate  in  the  achievement  of  an  overall  goal,  but  tend  to  oppose  each 
other.  The  following  specific  example  of  two  uncooperating  control  subsystems  is 
taken  from  the  currently  ongoing  flight  tests  of  the  Digital  Integrated  Automatic 
Landing  System  (DIALS)  [17]  at  NASA's  Langley  Research  Center. 

During  the  first  minute  of  this  flight  test,  the  aircraft  is  controlled  by  an 
altitude  hold  control  system  coupled  with  an  autothrottle  system  previously  designed 
using  a  conventional  classical  approach.  The  two  subsystems  were  designed  to  meet 
different  objectives,  the  goal  of  the  autothrottle  being  to  maintain  the  selected 
airspeed,  the  goal  of  the  altitude  hold  system  being  to  maintain  a  constant  altitude  or 
zero  sink  rate.  Figure  1  shows  the  thrust  (engine  pressure  ratio),  and  sink  rate 
history  (from  the  flight  charts).  As  seen  in  Figure  1.  the  sink  rate  oscillates  with  a 
peak-to-peak  deviation  larger  than  25  ft/sec,  instead  of  remaining  near  zero. 
Similarly,  the  thrust  is  seen  to  oscillate  with  a  peak-to-peak  deviation  of  14,000  lbs. 
in  the  autothrottle/altitude  hold  mode. 

This  behavior  of  the  autothrottle/altitude  hold  mode  can  be  traced  to  the  fact 
that  the  coupling  between  the  two  subsystems  in  terms  of  the  airspeed  and  the 
vertical  variables,  such  as  pitch  angle  and  sink  rate  through  the  aircraft  dynamics, 
was  not  sufficiently  accounted  for.  Thus,  when  the  aircraft  maintains  a  constant 
altitude,  the  oscillatory  behavior  does  not  occur.  However,  if  disturbances  reduce  the 
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aircraft’s  altitude,  the  altitude  hold  system  pitches  the  aircraft  up  to  obtain  more  lift, 
with  the  added  effect  of  also  increasing  the  drag.  The  autothrottle  then  notices  the 
decreasing  speed  and  commands  a  higher  throttle  which  produces  an  increasing  thrust 
with  a  lag  (due  to  the  slow  engine  dynamics).  Thus,  when  the  aircraft  reaches  its 
desired  altitude,  the  thrust  is  considerably  higher  than  its  required  trim  value  and 
overshoots  in  altitude  as  well  as  speed.  The  altitude  hold  system  pitches  the  aircraft 
down  to  get  back  onto  its  desired  altitude,  which  further  increases  the  speed,  and  the 
cycle  continues.  Clearly  the  two  control  subsystems  do  not  cooperate  when  both  are 
active,  whereas  each  one  performs  its  task  adequately  without  the  other.  This 
behavior  is  mainly  due  to  the  design  approach  where  each  subsystem  is  designed  with 
little  consideration  of  other  subsystems. 

At  approximately  one  minute  into  the  flight  test,  a  centralized  automatic  landing 
system  is  engaged.  As  can  be  seen  from  Figure  1.  this  centralized  control  system 
quickly  stabilizes  the  thrust  to  a  stable  trim  value  while  performing  a  glide  slope 
capture  maneuver.  The  centralized  controller  is  an  integrated  control  system  using 
full  state  feedback  based  on  modern  control  theory  principles.  As  this  simple  example 
demonstrates,  an  integrated  system  design  approach  is  often  necessary  to  ensure  the 
cooperation  of  various  subsystems  to  achieve  an  overall  objective.  In  this  case,  the 
penalty  on  fuel  efficiency  arising  from  the  lack  of  cooperation  between  subsystems  is 
clear.  On  the  other  hand,  the  interaction  between  the  subsystems  could  also  have  an 
indirect  but  quantifiable  impact  on  total  fuel  consumption.  While  the  centralized 
control  system  using  full  state  feedback  given  in  this  example  achieves  the  overall 
objective,  the  design  of  centralized  flight  control  systems  is  often  impractical. 
Moreover,  separate  control  subsystem  structures  are  more  desirable  in  military 
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applications  due  to  reliability  and  survivability  considerations.  A  method  to  design 
control  subsystems  which  act  in  cooperation  can  be  obtained  by  using  decentralized 
control  theory.  In  the  first  section  of  the  next  chapter,  we  shall  give  a  technical 
review  of  the  relevant  theory. 


.•  u  ■»**  km*  ,*.-i. 


2.  MATHEMATICAL  DEVELOPMENT 

This  chapter  contains  our  findings  concerning  the  design  of  a  set  of  coordinating 
subsystem  controllers.  We  start  with  an  overview  of  the  related  prior  work  m 
decentralized  control. 

2.1  Review  of  Related  Prior  Work 

During  the  last  three  decades,  a  large  body  of  system  and  control  theory 
developments  and  advances  in  computer  technology  have  enabled  control  and  system 
engineers  to  develop  generalized  algorithms  which  are  directly  applicable  to  complex 
system  design  problems.  The  major  developments  have  almost  invariably  considered 
systems  with  a  centralized  sensor  and  control  structure;  i.e.,  the  system  is  controlled 
by  a  single  control  unit  having  access  to  all  the  available  information  obtained  by  all 
the  sensors.  The  results  obtained  have  shown  that,  in  many  cases,  linear  feedback  of 
state  estimates  is  sufficient  to  provide  satisfactory  system  behavior,  and  it  is  ,  in  fact, 
optimal  for  the  LQG  problem.  Pole  placement  in  linear  systems  can  usually  be  achieved 
with  linear  feedback.  Efficient  numerical  algorithms  which  use  the  system  model  are 
available  to  determine  control  system  parameter  values.  These  algorithms  provide 
excellent  starting  points  for  the  system  designer  in  pursuit  of  a  working  centralized 
controller  for  a  complex  system  However,  these  developments  have  left  the  problems 
associated  with  decentralized  systems  largely  unsolved. 

While  systems  with  a  decentralized  sensor  network  where  a  decentralized  control 
-itructure  is  desirable  are  common,  (e.g..  electric  power  systems,  transportation 
systems,  economic  systems,  etc  ),  a  decentralized  control  structure  may  be  sought  for 
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reasons  other  than  a  decentralized  sensor  systea.  Exaaples  can  be  found  in  aircraft 
control  systeas,  where  the  natural  nodes  of  the  systea  are  widely  separated  (e.g.,  the 
structural  nodes  and  the  phugoid  node)  and  where  it  is  desirable  to  use  one 
subsysten  with  aany  others  depending  on  the  task  perforaed.  For  exaaple.  one  inner 
loop  systea  is  usually  used  with  different  outer  loop  guidance  systeas  that  depend  on 
the  path  to  be  followed. 

Recently,  soa«  attention  has  been  focused  on  questions  associated  with 
decentralized  systeas  [22].  Although  sons  results  have  been  obtained,  the  aain 
developaents  in  decentralized  systea  theory  have  been  of  a  negative  nature.  The 
separation  of  estiaation  and  control  is  not  optiaal  for  linear  decentralized  control 
systeas  with  quadratic  cost  and  Gaussian  disturbancas.  In  fact,  the  optiaal  control  is 
not  necessarily  a  linear  feedback  law,  as  noted  by  Vitsenhausen  [37];  in  general,  the 
existence  of  an  optiaal  law  is  not  guaranteed  [21]  for  decentralized  systeas.  and  the 
optiaal  linear  law  can  be  of  infinite  diaensions.  and  hence  not  realizable  [38]. 
Questions  as  to  the  iaportance  of  "signalling",  "second  guessing"  and  the  extent  of 
“cross-coaaunication"  aaong  decentralized  controllers  (which  do  not  arise  in 
centralized  systeas).  rcaain  to  be  answered. 

As  discussed  in  the  recent  survey  paper  [22],  the  work  on  decentralized  control 
theory  can  be  divided  into  the  following  broad  categories: 

o  stability  aethods. 
o  aodel  approxiaation  aethods. 
o  optiaal  decentralized  feedback, 
o  optiaal  decentralized  filtering. 
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o  multilevel  control  systems. 


Stability  methods  usually  consider  the  deterministic  case.  The  basic  objective  of 
this  approach  is  to  determine  if  a  system  can  be  stabilized  by  a  decentralized 
controller  with  a  specific  fixed  structure  and  to  obtain  algorithms  for  computing 
stabilizing  feedback  gains.  Both  Lyapunov  [23]-[24]  and  input-output  [25]-[26] 
methods  have  been  applied  to  the  stability  determination  problems  in  interconnected 
systems.  These  approaches  use  bounds  on  the  interconnection  effects  and  essentially 
treat  them  as  disturbances. 

Stabilizability  and  controllability  of  decentralized  systems  have  been  studied  in 
(27]-(29]  An  important  result  on  the  stabilizability  of  decentralized  systems  has  been 
derived  in  (28].  Namely,  it  is  shown  that  a  necessary  and  sufficient  condition  for 
stabilizability  is  that  the  fixed  modes  of  a  decentralized  system  should  have  negative 
real  parts  Furthermore,  the  computational  requirements  for  determining  the  fixed 
modes  consist  of  finding  the  eigenvalues  of  large  matrices,  for  which  efficient 
subroutines  are  available.  Pole  placement  methods  have  also  been  investigated 
(30]-(31]  These  methods  tend  to  load  a  single  local  controller  by  giving  it  most  of 
the  task  of  controlling  the  system.  Furthermore,  computational  schemes  associated 
with  these  methods  are  quite  complex. 

Model  simplification  techniques  for  decentralized  systems  fall  into  two  categories. 
Mtregation  methods  and  perturbation  techniques.  Aggregation  concepts  [32)-[33] 
generalize  the  standard  engineering  decisions  used  in  simplifying  large  scale  systems 
Rather  than  completely  ignoring  certain  parts  of  the  dynamics,  aggregation  methods 
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try  to  add  the  effect  of  neglected  modes  onto  the  simplified  model.  Singular 
pet  turbation  theory  has  also  been  used  effectively  in  model  reduction  problems 
[34]-[36]  lor  systems  where  the  natural  modes  are  widely  separated. 

Optimal  decentralized  control  laws  maximizing  a  quadratic  cast  function  have  also 
been  widely  studied.  The  celebrated  example  of  Witsenhausen  [37]  demonstrate  that 
the  solution  with  Gaussian  disturbances  is  not  linear  and  the  separation  theorem  does 
not  hold  in  stochastic  decentralized  control  problems.  It  was  further  shown  that  the 
optimal  linear  decentralized  law,  for  a  rather  simple  discrete  system  [38],  requires  an 
infinite  dimensional  controller.  Since  the  restriction  of  control  laws  that  are  arbitrary 
linear  functions  of  past  observations  do  not  necessarily  result  in  an  implementable 
solution,  the  next  attempt  has  been  to  restrict  the  controllers  to  be  of  a  linear  fixed- 
order  structure  and  to  optimize  over  the  parameters  of  this  structure.  A  stochastic 
suboptimal  design  is  considered  in  [39],  where  the  measurements  of  each  controller 
drive  a  local  filter  which  provides  unbiased  estimates  of  the  complete  system  and  the 
local  control  is  a  linear  feedback  of  the  local  estimate.  Clearly,  the  computational 
requirements  arising  from  the  use  of  a  large  filter  at  every  controller  are  very 
demanding. 

A  similar  approach  is  to  pose  the  decentralized  control  problem  as  a  constrained 
output  feedback  problem  [40]-[41].  For  instance,  the  method  in  [41]  requires  the 
solution  of  a  nonlinear  algebraic  matrix  equation  in  order  to  compute  the  parameters 
of  the  constrained  decentralized  compensators.  We  agree  with  the  view  stated  in  [22] 
that  the  fixed  structure  approach  is  feasible  and  is  the  most  promising  extension  of 
the  LQG  methodology  to  decentralized  systems.  The  main  difficulty  with  this  approach 
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it  that  satisfactory  algorithms  to  solve  the  problem  are  at  best  rare,  and  require 
lengthy  searches  at  every  iteration,  whenever  convergent  [42]-[4?].  A  review  and 
comparison  of  these  algorithms  can  be  found  in  [47]. 

In  decentralized  filtering,  extensions  of  the  standard  LQG  estimation  algorithms 
to  systems  with  fixed  information  exchange  patterns  have  been  studied.  For  instance, 
the  formulation  in  [48]  is  a  constrained  nonlinear  programming  problem  with  the  filter, 
and  control  gains  which  are  not  dictated  to  be  zero  by  the  decentralized  structure, 
taken  as  independent  variables.  Although  this  method  has  been  successful  in  traffic 
flow  applications  where  the  coupling  is  mostly  between  the  nearest  neighbors,  in 
general,  this  technique  neither  assures  closed-loop  stability  nor  convergence  to  a 
global  minimum  Ir  contrast  to  this  joint  optimization  approach  to  designing  the  local 
estimators,  in  [50],  the  authors  have  developed  locally  unbiased  filters  by  assuming 
that  complete  measurements  of  the  interactions  from  other  subsystems  into  the  local 
subsystem  are  available  to  the  local  decision  maker  along  with  at  least  one  local  state 
measurement  Their  result  is  an  uncoupled  set  of  filtering  algorithms  for  toe  local 
estimators  obtained  through  the  application  of  the  matrix  minimum  principle.  The 
main  disadvantage  of  this  technique  is  the  requirement  of  complete  measurements  of 
the  interaction  between  the  subsystems.  Another  class  of  decentralised  estimators 
results  from  the  application  of  perturbation  techniques  In  the  case  of  weak  coupling 
between  the  subsystems  [Si],  suboptimal  decentralized  estimators  have  been  obtained 
by  extending  separate  bias  estimation  technique  to  the  case  when  the  bias  states  are 
dynamically  coupled  (52)-(53)  with  the  system  states  and  then  using  perturbation 
methods  to  obtain  the  approximate  filters 
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We  also  note  that  the  solutions  to  the  decentralized  LQG  control  problem  have 
also  been  obtained  (54]-(55j.  Computation  of  these  optimal  Nash  strategies  involve 
the  solution  of  coupled  Riccati  matrix  equations  (55].  There  has  also  been  some 
applications  of  these  results  to  aircraft  control  systems.  For  instance,  the  computed 
SAS  and  pilot  control  laws  in  (56]  are.  in  fact,  the  optimal  Nash  strategies  in  the 
space  of  linear  full  state  feedback  controls.  The  major  drawback  of  this  approach  is. 
of  course,  the  requirement  for  full  state  feedback. 

Multilevel  control  structures  for  decentralized  control  have  also  been 
investigated  (57]-(59]  The  optimal  Stackelberg  strategies  for  these  systems  are 
derived  such  that  one  decision  maker,  called  the  leader,  announces  his  feedback 
strategy  before  the  other  decision  makers,  called  followers,  select  their  control 
strategies  Optimal  Stackelberg  strategies  tor  LQ  games  can  be  computed  by  solving 
coupled  Riccati  matrix  equations  (58]-(59]  Other  multilevel  controller  structures 
involving  a  high  level  coordinator  manipulating  lower  order  controllers  have  been 
explored  in  (60]  The  applicability  of  multilevel  controller  structures  to  aircraft 
control  problems  remains  to  be  established 

In  summary,  we  believe  that  decentralized  stochastic  control  and  estimation 
methods  using  linear  and  fixed  controller  and  estimator  structures  appears  to  be  the 
most  feasible  approach  for  aircraft  applications.  The  fact  that  this  formulation  does 
not  address  the  question  of  what  structure  should  be  assumed  may  be  considered  a 
drawback  in  genera)  decentralized  system  applications  However,  this  aspect  would  not 
be  a  problem  in  flight  control  system  applications  due  to  the  large  known  body  of 
knowledge  about  aircraft  control  subsystems  In  the  next  section,  we  shall  present 


the  mathematical  description  of  the  class  of  problems  which  will  be  considered  in  our 
study. 

S.2  Formulation  of  the  Optimal  Decentralised  Control  Problem 

Since  the  optimal  decentralised  control  law  for  a  linear  plant,  quadratic  cost  and 
Gaussian  statistics  can  be  nonlinear,  and  the  optimal  linear  control  law  can  be  of 
infinite  dimensions  [38].  hence  not  implementable.  the  nest  natural  class  of  control 
laws  that  can  be  considered  is  the  class  of  implementabie  linear  decentralised  control 
laws.  i.e..  a  decentralised  control  law  where  each  subsystem  controller  is  constrained 
to  be  of  finite  order.  The  order  of  each  subcontroller  is  considered  a  design 

parameter  specified  by  the  designer.  It  is  assumed  that  the  plant  has  been  linearised, 
and  that  a  stochastic  sampled-data  formulation  has  been  selected  for  digital 

implementation  [61]  Thus,  we  consider  the  following  discrete-time  stochastic  linear 
plant 

x#(k+l)  -  Aex#(k)  +  B,  u,(k)  4  w#(k).  k  >  0  .  (1) 

where  x#(k)  is  the  n-»ector  state.  Uj(k)  is  the  Sj-vector  control  for  the  ith 

subsystem,  and  w#(k)  is  a  sero-mean  wuite  noise  sequence,  where  (denoting  the 


expectation  operator  by  C) 

E(w#(k))  -  0  and  E(x0(0))  -  0  (?) 

E(w#(k)  w  o0))  -  W#4hj  (3) 

E(w#(k)  x  #(0))  -  0  (4) 

E(x#(o)  r9m  •  S#  (5) 
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In  usual  applications  of  decentralized  control,  the  plant,  AQ,  contains  a  number 
of  loosely  coupled  subsystems  controlled  by  the  subsystem  controls,  Uj(k).  Each 
subsystem  control,  Uj(k),  is  constrained  to  use  only  a  corresponding  set  of 
measurements,  y ; (k),  accessible  to  that  controller.  That  is,  we  consider  the  following 
nonclassical  information  pattern; 

y i ( k )  =  Cj  x(k)  +  Vj(k)  1  <  i  <  P  (6) 

where  y,(k)  is  a  mj -vector  measurement  available  to  the  i'th  subsystem  controller, 
Vj(k)  is  a  zero-mean  white  measurement  noise  sequence,  and 


E(v,(k))  =  0 

(7) 

E(Vj(k)  V.(l)>  -  Vjj6k| 

(8) 

E(v.(k)  x'o(0))  =  0 

O) 

E(v.(k)  w  o(l))  .  0 

(10) 

As  seen  from  above,  it  is  assumed  that  the  plant  process  noise  sequence, 
measurement  noise  sequence,  and  plant  initial  condition  are  mutually  uncorrelated  It 
should  be  pointed  out  that  the  initial  condition  having  zero  mean,  and  the 
measurement  and  plant  noises  being  uncorrelated  are  conditions  which  can  be  easily 
relaxed  at  the  expense  of  slightly  more  complicated  expressions  in  the  following 

The  measurement  vectors,  yj(k),  are  not  restricted  to  contain  different 
components,  and  may  contain  common  variables  That  is,  the  formulation  encompasses 
the  case  in  which  the  state  measurements  are  divided  into  subsets  with  nonempty 
intersections  The  significance  of  allowing  the  same  variable  m  the  feedback  of 
different  subcontroilers  is  that  coordination  between  subsystem  controllers  can  be 
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greatly  enhanced  by  selecting  appropriate  common  feedback  components.  On  the  other 
hand,  the  case  inwhich  there  is  no  correlation  between  the  measurement  noises 
corresponding  to  different  subsystems  is  included  in  this  formulation  as  well. 

Similarly,  the  formulation  presented  here  allows  the  use  of  the  same  control 
component  in  more  than  one  subsystem  controller,  when  this  is  desirable.  To 
illustrate  this  point,  consider  the  case  where  the  aileron  is  used  to  achieve  the  two 
goals  of  flutter  suppression  and  flight  path  control.  The  aileron  would  then  be 
included  in  both  the  flutter  suppression  subcontroller  and  the  flight  control  system. 
The  flutter  suppression  subcontroller  would  feed  back  accelerometer  measurements 
placed  at  appropriate  locations  on  the  wing,  and  would  have  high  frequency  content. 
Whereas  the  flight  path  subcontrolier  would  feed  back  flight  path  variables  and  have 
relatively  lower  frequency  content.  Thus,  the  total  aileron  command  would  contain 
both  high  and  low  frequency  components  achieving  both  flutter  suppression  and  flight 
control  objectives  in  a  coordinated  manner.  However.if  desired,  the  flutter 
suppression  subcontroller  commands  could  be  computed  in  a  small  microprocessor 
located  at  or  near  the  wing,  rather  than  a  central  computer. 

As  mentioned  earlier,  it  is  desirable  to  obtain  subsystem  controllers  which  are  of 
finite  order,  so  that  their  implementation  is  possible  and  simple  Furthermore,  to 
obtain  a  decentralized  control  structure  it  is  necessary  for  u,(k)  to  depend  only  on 
past  and  present  measurements  of  the  selected  measurement  vector  T|(k).  Therefore, 
we  consider  the  class  of  controllers  where  each  subsystem  controller  is  constrained  to 
be  a  finite  order  linear  dynamic  system  of  the  form 

z j(k+ 1 )  -  E,  Zj(k)  4  H,  y,(k)  (11) 
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u,.(k)  -  G.  Zj(k)  +  F.  yf(k)  1  <  i  <  p  (12) 

where  z((k)  is  the  qj'*vector  representing  the  state  of  the  dynamic  compensator  for 
the  ith  subcontroller  driven  by  the  appropriate  measurement  vector.  The  order  of  the 
dynamic  compensator,  q ; ,  for  each  subsystem  is  a  design  specification  to  be  selected 
by  the  designer.  The  controller  is  formulated  to  be  time  invariant;  i.e.,  E-,  Hj,  G;,  F; 
do  not  vary  with  time.  These  parameters  which  determine  the  dynamic  compensation 
and  control  commands  are  the  parameters  for  optimization. 

As  each  subcontrolier  has  a  somewhat  different  task,  a  cost  or  objective  function 
is  selected  to  describe  each  subcontroller  task,  in  the  form 

J.  =  lira  JIM  (13) 

i  n_>  in 

N 

JlN  “  57S+T7  E  E  *o<k+1>  Qi  *0<k+1>  +  uVk)  Rl  u|00  0<) 

k-0 

Note  that  J|N  is  the  cost  criterion  over  a  finite  period  of  time,  while  is  the 
average  steady-state  cost,  which  is  the  desired  criterion  Note  that  J,N,  hence  J , , 
depend  not  only  on  the  ith  subcontroller  parameters,  but  on  all  the  subcontrollers. 
That  is,  due  to  the  coupling  between  the  subsystems  of  the  plant,  the  optimal  strategy 
for  one  subsystem  controller  depends,  even  if  slightly,  on  the  other  subsystem 
controller  strategies.  As  this  coupling  is  incorporated  in  the  plant  equations  and  the 
cost  functions,  the  optimization  drives  the  subsystem  controllers  to  cooperate  to  the 
extent  possible.  For  instance,  in  aircraft  flight  control  applications,  the  autotbrottle 
subystem  objective  may  be  to  null  the  airspeed  error  using  a  minimum  of  throttle 
activity,  while  the  objective  of  the  pitch  stability  augmentation  subsystem  would  be  to 
provide  adequate  damping  with  low  elevator  activity.  However,  the  overall  design 
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objective  is  to  meet  all  the  subsystem  objectives  which  must  operate  simultaneously,  so 
that  each  subsystem  enhances  the  operation  of  the  others  rather  than  degrade  it. 
Hence,  the  cost  or  objective  function  for  the  total  decentralized  control  law  is 
formulated  as  a  weighted  linear  combination  of  the  objectives  of  each  subcontroller: 

J  =  lim  (15) 

N->  N 

P 

JN  =  £  a.  JjN  a  j  >  0  1<  i  <  p  (16) 

i-l 

where  Q;'s  are  selected  according  to  the  relative  importance  of  subsystem  objectives. 

The  optimal  decentralized  control  problem  can  now  be  posed  as  the  problem  of 
finding  the  parameters,  |E*.  H*.  G*.  F*.  1  <  i  <  p,|  of  a  decentralized  control  law  of 
the  form  (l  1 )  and  (12),  which  stabilize  the  closed-loop  system  and  minimize  the  cost  J 
in  (15),  subject  to  the  constraints  imposed  by  the  system  dynamics  and  the 
information  pattern  given  in  (1)  -  (10). 

It  is  important  to  note  that  in  this  formulation,  when  an  optimal  control  exists, 
it  will  be  implementable,  and  will  stabilize  the  closed-loop  system.  The  optimization 
problem  will  be  posed  with  more  mathematical  rigor  in  Section  2.4.  Before  that 
however,  we  will  present  our  results  on  nonconflicting,  quadratic  multicriteria 
selection  in  the  next  section. 

2.3  Nonconflicting  Multi-Criteria  Selection 

The  cost  functionals,  eq.  13,  for  various  subsystem  controllers  will,  in  general, 
have  conflicting  requirements.  For  simplicity,  the  desired  set  points  for  subsystems 
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are  taken  to  be  null  vectors  in  eq.  13.  In  practice,  the  desired  set  point  for  some 
subsystem  may  be  a  specific  trajectory  or  the  output  of  an  ideal  model  to  be  followed 
162]- 

In  this  case,  the  subsystem  objectives  may  be  conflicting  with  each  other  in  the 
sense  that  while  one  subsystem  controller  is  trying  to  force  a  certain  system  state  to 
be  small  for  a  smooth  response,  another  subsystem  controller  may  well  be  encouraging 
the  same  state  variable  to  be  large  in  order  to  follow  a  certain  trajectory.  This 
difficulty  may  be  overcome  if  the  relative  importance  of  i'th  objective  relative  to  the 
other  objectives  can  be  specified  so  that  other  cost  functionals  can  be  modified  for 
noninteraction. 

In  this  section,  we  define  the  notion  of  noninteraction  between  quadratic  cost 
functionals  and  give  a  necessary  and  sufficient  condition  for  it.  Our  results  are  based 
on  the  following  theorem  from  matrix  theory  (See  Theorem  12  on  pg.  10  in  [65]): 

Theorem  Jh  Let  H  be  a  linear  transformation  on  Rn  to  R*.  i.e.  H  R"->R*.  If  is 

the  pseudo-inverse1  of  H,  then  we  have  the  following  direct  sum  decompositions  for  R" 

and  R": 

R"  =  N(H)  O  R(H*H)  (17) 

R*  =  R(H)  O  N(HH*)  (18) 

Vctuolly,  theee  results  hold  tor  the  veoker  generoliied  invert*.  Hovevor,  ere  oill  need 
the  properties  of  the  pseudo- inveree  in  the  fol loving. 
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where  N  and  R  denotes  null  space  and  range  of  the  associated  operator. 

For  every  vector  x  in  Rn  and  y  in  R1*,  the  representations  for  the  direct  suns  in 
the  theoren  above  are  given  by; 

x  =  [I-H*H]x  +  H*Hx  for  x  in  Rn  (19) 

y  =  HH*y  +  (l-HH*]y  for  y  in  Rm  (20) 

where  H^1  is  the  pseudo-inverse  of  H.  The  first  tern  in  eq.  (19)  above  is  the 
projection  of  x  onto  the  null  space  of  H  and  the  second  tern  is  the  corresponding 
orthogonal  conplenent  (i.e.,  the  projection  onto  the  range  of  H  ).  Let  us  verify  these 
assertions.  Starting  with  the  first  tern; 

H  [l-H*H)x  =  [H-HH#H]x  =  [H-H]x  =  0  (21) 

Eq.  21  follows  since,  by  definition,  we  have  H=HH^H.  Therefore.  [l-H*H]x  is  in 
the  null  space  of  H.  Now.  taking  the  inner  product  of  the  two  terns  in  eq.  19.  we  have 

<[l-H#H]x.  H*Hx>  =  x'[H^H  -  (H#H)H*H]x  (22) 

Since  we  have  (H^H)'  =  H^H  from  the  definition  of  the  pseudo-inverse, 

eq  21  becomes 

<[l-HlH]x.  H*Hx>  *=  x'(H^H-H^(HH^H)]x  *  0  (23) 

so  that  the  second  tern  is  indeed  the  orthogonal  conplenent.  Representation  for  y  m 
eq.  20  can  similarly  be  proved. 

Now,  returning  back  to  subsystem  controller  functionals  described  by  eqs.  13-14. 
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we  will  now  show  how  conflicting  requirements  can  be  taken  out.  For  instance, 
suppose  the  designer  decides  that  the  first  controller  objective  is  relatively  more 
important  than  the  objective  of  the  second  subsystem.  Hence,  it  is  desired  to 
constrain  the  second  subsystem  cost  functional,  so  that  the  objective  of  the  second 
controller  is  not  in  conflict  with  that  of  the  first  one.  Denoting  the  square  root  of  Q. 
in  eq.  14  by  0 j  =  H '  j H 5 ,  if  we  constrain  the  weighting  matrix  Q2  of  the  second  controller 
to  be  of  the  form 

Q2  =  [1-H^H,]'  H  Hll-HjH,]  (24) 

where  H  is  arbitrary,  then  the  second  objective  would  not  be  in  conflict  with  the  first 
one.  This  is  because  the  second  controller  would  penalize  only  those  state  excursions 
which  are  in  the  null  space  of  H,.  This  follows  from  the  discussion  following  Theorem 
1  since  the  vector  [l-H^Hjx  for  arbitrary  x  in  Rn  will  be  in  the  null  space  of  H,. 

We  would  like  to  be  able  to  choose  the  arbitrary  matrix  H  in  eq.  24  such  that 

[Hh{k,]  H  H(I-h{h,]  =  H’2H2  (25) 

or.  what  is  the  same. 


If  we  could  choose  an  H  such  that  eq  26  is  identically  satisfied,  then  the  second 
controller  s  cost  functional  need  not  be  modified.  However,  in  general,  there  would 
not  be  a  solution  of  this  equation  for  H  The  best  approximate  solution  in  the  least 
squares  sense  would  be  given  by 

H*  =  Hjll-HfH,]1  (27) 
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We  will  now  show  that  the  generalized  inverse  of  [l-H^Hj]  is  equal  to  itself  To 
show  this,  we  will  need  the  following  facts: 

Lemma  1_:  If  P  is  an  idempotent  [63]  matrix,  then  1-P  is  also  idempotent. 

Proof;  Recall  that  P  is  idempotent  if  P2=P.  So,  (1-P) 

(1-P)  -  1-P-P+P2=1-P-P+P=1-P. 

Lemma  2.  If  a  real  symmetric  matrix  P  is  idempotent,  then  P^=P. 

Proof.  This  follows  since  PPP=PP=P  and  (PP)‘=P'=P=PP. 

We  can  now  find  the  generalized  inverse  of  1-H^H  using  these  results  above. 

Theorem  L  If  H  is  an  arbitrary  matrix,  then  [1-H^H]*  =  1-H^H 

Proof:  Since  (H^H)H^H  -  H*(HH*H)  ■  H*H.  the  matrix  H*H  is  idempotent  It  then 
follows  by  Lemma  1  that  1-H^H  is  idempotent  Since  1-T!^H  is  also  symmetric,  by 
Lemma  2.  we  have  [l-H*Hj#  «  [l-H*Hj. 

Therefore,  the  best  approximate  solution  H*  given  by  eq  (27)  becomes 
H*  -  H2[1-h{h,]  (28) 


Substituting  the  expression  for  H*  into  eq  24  and  simplifying,  we  get  for  the 


s-cond  cost  functional 


Q2  =  [1-HfHjH  2  H^l-HfH,]  (29) 

That  is,  the  second  cost  functional  when  modified  as  above  would  not  be  in 
conflict  with  the  first  one.  These  results  generalize  those  on  pp.  248-250  in  [64]. 
Note  that  if  H2[I-H^H,]  =  H2,  then  Q2  would  be  nonconflicting  with  without  any 
modification.  Since  this  condition  would  imply  HjH^H^O,  it  suggests  the  following 
definition  for  two  noninteracting  cost  functionals. 

Definition  JL  Let  and  Q2=H'2H2  be  positive  semi-definite  matrices.  The 

quadratic  forms  x'Q,x  and  x'Q2x.  are  noninteracting  if  HjH^H^O. 

We  will  next  show  that  the  definition  is  symmetric.  That  is.  we  can  interchange 
the  subscripts  1  and  2.  Before  that,  however,  we  need  the  following  fact: 

Lemma  3.  If  H  is  an  arbitrary  matrix,  then 

Proof.  Since  we  have  H'»[H(H^H)]’»(H^H)'H'.  From  the  definition  of  the 

pseudo-inverse,  we  have  so  that 

Theorem  2.  Let  and  Q2»H‘2H2  be  positive  semi-definite  matrices.  The 

quadratic  forms  x'Q,x  and  x‘Q2x  are  noninteracting  if  and  only  if  H,H^H2»0. 

Proof  Let  Q,  and  Q2  be  nomnteracting  Then,  we  have  HjHfH^O.  Post 

multiplying  by  H'r  we  get  H2(H^H,H'.,)*0.  Since  by  Lemma  S.this  implies 
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H2H’1=0.  This  would  imply  H1H'2=0  Postmultiplying  by  (HJ)'  H|H2  and  using  the  fact 
H'2  (h|)’H^=H^,  we  get  HjH^HjsO.  Starting  from  it  can  similarly  be  shown 

that  this  would  imply 

A  computational  check  for  noninteraction  is  given  by  the  following: 

Theorem  3.  Let  Qt  =H’1H1  and  Q2=H'2H2  be  positive  semi-definite  matrices.  Two 
quadratic  forms  x’t^x  and  x'Q2x  are  noninteracting  if  and  only  if 

Proof.  Let  Q,  and  Q2  be  noninteracting.  We  then  have  H^H^O.  Postmultiplying 
by  H',,  we  get  H2(HfH1H,1)*=0.  Since  this  implies  HjH^-O. 

Now  let  HjH'^O.  Postmultiplying  by  we  get  Since 

this  implies  that  H2h{h,*=0. 

By  using  the  necessary  and  sufficient  condition  for  noninteraction  given  by 
Theorem  3  above,  it  can  easily  be  determined  whether  two  quadratic  cost  functionals 
are  non-interacting  or  not.  The  following  example  outlines  the  procedure. 


Example  1_  Let  and  H2'H2>Q2  be  two  weighting  matrices  given  by 

and  H2  *  [h  1  h2  hj) 


1  1  o"| 

H,  - 

0  1  -  ij 


So  H.H'2*0  implies  that  h,  +  h2»0  and  h2-hj»0.  Therefore,  any  H2-h[l-l-l) 


wou'd  produce  a  non -conflicting  weighting  matrix. 

2.4  Extenaion  to  Multiple  Subsystems 

Noninteracting  quadratic  cost  selection  procedure  can  be  extended  to  multiple 
cost  functionals,  if  the  relative  importance  of  controller  subsets  with  respect  to  each 
other  can  be  specified  by  the  designer.  For  instance,  the  objectives  of  subsystems 
subset  (S1(S2)  may  be  more  important  than  that  of  the  third  subsystem.  On  the  other 
hand,  the  objectives  of  subsystems  subset  (Sj,S4,S5)  may  be  considered  to  be  more 
important  than  those  of  the  subset  (S#,S7).  In  this  fashion,  a  hierarchy  of  importance 
levels  can  be  specified  for  subsystem  subsets.  Then  the  quadratic  costs  can  be 
chosen  in  the  following  manner  such  that  the  subsystems  criteria  would  not  be 
conflicting  with  each  other. 


In  the  two  subsystem  case,  say  i  th  and  j'th  subsystems,  the  result  is  obtained  by 
writing  the  state  space  as  a  sum  of  the  range  of  H,  and  its  orthogonal  complement 
and  constraining  the  j'th  controller  cost  functional  onto  this  orthogonal  complement. 
In  the  case  of  multiple  subsystems,  for  instance  in  the  example  above,  third  subsystem 
cost  is  constrained  onto  the  orthogonal  couplement  of  the  range  H12  where: 


H 


12 


H, 


(30) 


In  this  case,  the  third  subsystem  quadratic  form  would  then  be  given  by 
(referring  back  to  eq.  24). 

-  U-h{2H,2)  H  H  (1-h{2H12]  (31) 
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where  H  is  arbitrarily  selected. 


2.6  Weaker  Nonconflicting  Criteria 

Nonconfhcting  quadratic  criteria  selection  procedure  can  be  Modified  to  have 
weaker  restrictions  on  the  subsystem  cost  functionals.  For  instance.in  the  case  of 
subsystems  one  and  two.  it  is  possible  to  restrict  the  second  controller  functional 
either  onto  the  null  space  of  H1  or  onto  the  orthogonal  complement  of  the 
controllability  subspace  of  the  first  controller.  To  illustrate  the  procedure,  consider 
the  controllability  subspace  of  the  first  controller,  i.e.. 

r,  =  [B1AB1A2B1....An-1B1]  (32) 

From  the  discussion  following  Theorem  1.  the  transformation  T,  is  associated  with  the 
following  direct  sum  decomposition  of  the  state  space  Rn: 

R"  -  R(I\)  *  Kiyf)  (33) 

So  that  the  second  controller  cost  functional  can  be  restricted  to  penalize  the  state 
excursions  either  in  the  null  space  of  H1  or  in  the  null  space  of  I^rf.  Since  the 
representation  for  this  direct  sum  decomposition  is  given  by  eq.  20.  i.e.. 

X  «  r,rfx  ♦  (i-r,rf)x  (34) 

Therefore,  the  second  subsystem  cost  functional  can  be  constrained  to  be 

S  -  ♦  Ii-r1rf|,KKi-r1rf|  (35) 

where  Q2  is  given  by  eq  24  and  H  is  an  arbitrary  matrix. 


26 


In  the  next  section,  we  will  discuss  how  the  decentralized  stochastic  optimal 
control  design  posed  in  Section  2.2  can  be  formulated  as  a  constrained  optimal  output 
feedback  problem. 

2.6  Equivalent  Constrained  Output  Feedback  Problem 

Our  primary  objective  is  to  develop  methods  for  obtaining  satisfactory 
decentralized  control  laws  which  are  implementable  and  computable.  To  this  end,  we 
will  pose  the  decentralized  stochastic  control  problem  under  consideration  as  a 
constrained  output  feedback  problem.  By  augmenting  the  state  vector  with  the 
compensator  states  and  restricting  the  output  feedback  gains  to  be  block  diagonal, 
the  decentralized  stochastic  control  problem  defined  by  eqs.  1-16  can  be  posed  as  a 
constrained  stochastic  output  feedback  problem  of  the  form  [67]. 

x(k+l)  *  Ax(k)  +  Bu(k)  +  w(k)  (36) 

y(k+l)  *  Cx(k+1)  +  v(k+ 1)  (37) 

where  the  augmented  state  vector  x(k)  and  the  composite  control  u(k).  measurement 
y(k).  process  noise  w(k).  measurement  noise  v(k)  vectors  are  defined  by 


where  Wj(k).  1<  i  <  p.  are  zero  mean  white  noise  sequences  viewed  as  design 
parameters  to  account  for  implementation  or  other  uncertainties. 


where  Uj(k).  1  <  i  <  p.  ere  additional  control  vectors  which  will  be  optimized  to  design 
the  finite  order  dynamic  compensators.  Note  that  the  digital  dynamic  compensator 
state.  Z|(k).  which  will  be  computeu  by  the  subcontroller  computer  is  known,  and  is 
included  in  the  subcontroller  measurement  vector.  The  measurement  noise.  n{(k). 
associated  with  Zj(k).  may  be  selected  as  zero,  if  desired.  Otherwise,  round-off  or 
other  noise  effects  can  be  modelled.  The  variances  for  the  composite  process  noise. 
w(k).  and  the  measurement  noise  v(k)  will  be  denoted  by  V  and  V.  respectively 


The  composite  system  matrices  are  given  by 


(41) 


where  lj  js  the  qj  x  q;  identity  matrix. 


with 


The  augmented  control  vector,  u(k),  can  now  be  expressed 
u(k)  =  -  K  y(k) 

where  the  gain  K  is  constrained  to  be  of  block  diagonal  form;  i. 


K,  0  .  .  .  0 

0  k2 


block  diag  (Kf ,  1  <  i  <  p). 


Equations  36-46  inbed  the  implementable  decentralized  control  problen  into  a 
constrained  stochastic  output  feedback  problem,  the  constraint  being  described  in 
eq.  44. 


The  overall  cost  or  objective  function  can  be  expressed  in  terns  of  the 
augmented  system  parameters  in  the  form 


J(K)  =  lim  Jn(K) 

N->  N 

JW(K)  =  — - —  E  E  x'(k+l)  Q  x(k+l)  +  u‘(k)  J?  u(k) 

N  2(M+1)  k-0 

0  =  £  s,  Q. 

1-1  1  ' 

R  =  block  diag  (R5,  1  <  i  <  p) 


1 - 

o 

l2_ 

Qi  O’ 

* 

0  R, 

• 

0  0 
*  m 

(47) 

(40) 

(49) 

(50) 

(51) 


It  is  important  to  note  that  the  problem  will  be  sol/ei  for  arbitrary  Q  and  R  of 
non-negative  definite  form,  so  that  the  decentralized  control  problem  is  a  special 
case.  That  is.  when  desirable  for  design  objectives,  the  compensator  states  and 
controls  can  be  penalized  by  selecting  Q|  and  R,  appropriately. 

As  we  are  interested  in  the  steady-state  or  infinite-time  optimization  problem. 

« 

consider  the  limit  in  eq.  47.  Let  D  be  the  set  of  gains  (not  necessarily  block  diagonal) 
for  which  JN(K)  converges  to  a  finite  limit  J(K),  and  let  1^  be  the  subset  of  D  consisting 


33 


of  block  diagonal  gains,  i.e., 

D  =  {K|lim  Jn(K)  <  {  (52) 

Dg  =  {KjK  in  D  and  K  is  block  diag  }  (53) 

Similarly,  we  define  the  stabilizing  gain  set  S  and  its  subset  Sg  consisting  of 
block  diagonal  stabilizing  gains  by; 


S  =  }K|p(A  -  B  K  C)  <  lj 

(54) 

Sg  =  K|K  in  S  and  K  is  block  diag.  j 

where  p  denotes  the  spectral  radius. 

(55) 

We  pose  the  optimal  decentralized  control  problem  as; 

A* 

minimizes  the  cost  function  J(K)  over  Sg;  i.e.. 

** 

Find  a  K*  in  Sg  which 

J(K*)  <  J(K)  for  all  K  in  Sg 

(56) 

In  this  formulation,  when  an  optimal  solution  exists,  it  has  a  decentralized 
structure,  it  is  implementable,  and  it  stabilizes  the  closed-loop  system. 
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2.7  Existence  of  an  Optimal  Decentralized  Control 


As  mentioned  previously,  the  general  optimal  decentralized  LQG  problem  over  the 
class  of  linear  and  nonlinear  controllers  can  result  in  a  nonlinear  controller,  and  the 
existence  of  an  optimal  controller  is  not  guaranteed.  Thus,  it  is  of  interest  to 
investigate  conditions  which  ensure  that  an  optimal  controller  exists  for  the 
decentralized  control  problem  formulated  here,  before  attempting  to  find  an  optimal 
controller  which  may  not  even  exist.  As  will  be  shown  in  the  following,  for  a  large 
class  of  realistic  problems,  an  optimal  solution  does  indeed  exist. 

The  major  contribution  of  this  section  is  the  following  (referring  back  to  the 
previous  section  for  notation)  existence  result: 

o  Block  output  stabilizability  of  (C.A.B),  positive  definiteness  of  B'QB+R  and 
CWC'+V,  and  the  existence  of  a  positive  scalar  s  with  positive  semi-definite 
Q-sC'C  and  W-sBB'  are  a  sufficient  set  of  conditions  for  the  existence  of  an 
optimal  decentralized  control. 

The  development  of  existence  conditions  and  algorithms  to  obtain  gams  for  the 
optimal  implementable  decentralized  control  problem  closely  follows  the  development 
for  the  unconstrained  stochastic  output  feedback  problem  reported  in  [66].  We  will 
make  extensive  use  of  these  results  by  modifying  them  to  account  for  the  block 
diagonal  gain  constraint.  The  following  results  from  the  unconstrained  output 
feedback  problem  are  given  for  completeness  The  proofs  can  be  found  in  [66]. 

aw 

Lemma  4  S  is  a  subset  D  and  for  any  K  in  S.  the  cost  J(K)  can  be  expressed  as 
J(K)  =  5  tr)P(K)  Wj  +  5  trjK'  F(K)  K  V[  (57) 
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where 


P(K)  =  B'  P(K)  B  +  R 

(58) 

and  where  P(K)  is  the  solution  of 

P(K)  =  A(K)’  P(K)  A(K)  +  C  K'  R  K  C  4  Q 

(59) 

with  the  closed-loop  system  matrix  A(K)  defined  by 

A(K)  =  A  -  B  K  C 

(60) 

Lemma  5:  J(K)  and  P(K)  are  continuous  on  S. 

Lemma  6:  Let  (C.  A.  B)  be  output  stabilizable,  and  Q  >  s  C‘  C,  W  >  s  B  B'  for 

9m  M 

some  s  >  0.  Then  S(a)  =  jK  in  SjJ<K)  <  a)  is  closed  for  all  a  in  R. 

9m 

Lemma  7:  Let  B'  Q  B  +  R  >  0  and  C  W  C  +  V  >  0,  Then  S(a)  is  bounded. 

Using  these  results,  we  shall  now  show  that  an  optimal  decentralized  control 
exists  for  a  large  class  of  problems.  The  following  corollaries  follow  from  the 
preceding  lemmas 

*m  9m 

Corollary  \  is  a  subset  of  1^. 

Proof  By  Lemma  4.  Sg  is  a  subset  of  S.  It  follows  that  JN(K)  ->  J(K)  <  and  K 

a*  9m 

is  in  E^.  whenever  K  is  in  S^. 

9m 

Corollary  2  J(K)  and  P(K)  are  continuous  on  S^. 


36 


Proof;  Since  Sg  is  a  subset  of  S,  Lemma  5  holds  for  Sg. 


Definition  2;  The  triplet  (C.A.B)  is  block  output  stabilizable  if 

p(A  -  Bj  Kj  Cj)  <  1  for  some  block  gain  K  =  }K1t  K2.  ...  Kp|. 
where  p  is  the  spectral  radius. 

Note  that  if  K  is  block  diagonal 

A(K)  «A-BKC«A-jf  B.  K.  C.  .  (61) 

i-1  1  1  1 

We  will  need  the  following  definition  for  the  fixed  modes  of  a  decentralized 
structure  and  the  relationship  between  fixed  modes  and  block  output  stabilizability. 

to 

Definition  3;  Given  a  triplet  (C.A.B)  and  the  given  set  K  of  block  diagonal 

to 

matrices,  the  set  of  fixed  modes  of  (C,A,B)  with  respect  to  K  is  defined 

A  =  O  ~  o(A+BKC)  (62) 

K  in  K 

where  o(A)  is  the  spectrum  of  A. 

Lemma  6;  Consider  a  decentralized  system  defined  by  the  triplet  (C.A.B)  and  the 

to 

associated  set  K  of  block  diagonal  matrices.  A  necessary  and  sufficient  condition  for 
the  block  diagonal  stabilizability  of  (C.A.B)  is  that  the  fixed  modes  of  (C.A.B)  be  stable. 

Proof  See  Theorem  1  in  (26]. 
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Lemma  9.  If  (C,A,B)  is  block  output  stabilizable,  then  (C,A,B)  is  output 
stabilizable 

Proof:  If  (C,A,B)  is  block  output  stabilizable,  then  (C,A,B)  can  be  stabilized  by  a 
block  diagonal  gain.  Hence,  (C.A.B)  is  output  stabilizable. 

Corollary  3.  Let  (C,A,B)  be  block  output  stabilizable,  and  Q  >  s  C’  C,  W  >  s  B  B’ 
for  some  s  >  0.  Then  %(a)  =  JK  in  %|J(K)  <  a)  is  closed  for  all  a  in  R. 

Proof:  By  Lemma  9,  (C.A.B)  is  output  stabilizable,  and  by  Lemma  6,  S(a)  is  closed. 
Note  that  %(a)  =  5(8)0%  Let  K'  be  in  Sg(a)  and  K1  ->  K.  Since  K'  is  in  5(a)  also, 
and  S(a)  is  closed,  the  limit  K  is  in  S(a).  As  the  limit  of  a  block  diagonal  sequence  of 

iw  a> 

matrices  is  also  block  diagonal,  K  is  in  %.  Hence.  K  is  in  %(a),  and  %(a)  is  closed. 

Corollary  4:  Let  B’  Q  B  +  R  >  0,  and  C  W  C'  +  V  >  0.  Then  %(a)  is  bounded. 

Proof:  %(a)  is  a  subset  of  S(a)  which  is  bounded  under  the  assumed  conditions. 
Hence  %(a)  is  bounded. 

Theorem  4.  Let  the  fixed  modes  of  (C.A.B)  be  stable,  Q  >  s  C’  C.  W  >  s  B  B‘  for 
some  s  >  0.  B‘  Q  B  +  R  >  0,  C  W  C'  +  V  >  0.  Then  there  exists  a  K*  in  %  such  that 

J(K*)  <  J(K),  for  all  K  in  % 

Proof  By  Lemma  9.  (C.A.B)  is  block  output  stabilizable.  By  Corollary  1.  %.  hence 


E^,  is  not  empty.  Thus,  let  J*  =  inf  J(K)  <  « .  Necessarily,  there  is  a  sequence 
}K',i  >  0}  in  Sg  such  that  J(K®)2  I  JV  Let  Sgg  =  jK  in  Sg|J(K)  <  J(K°)j.  By  Corollaries 
3  and  4,  Sj  is  closed  and  bounded  Using  the  Bolzano-Weierstrass  theorem.  )K\  i  > 
Oj  has  a  limit  point,  say  K*.  which  belongs  to  SgQ  Hence,  K*  is  in  Sg  By  Corollary  2. 
J(K)  is  continuous  on  Sg,  therefore,  if  }K,J.  j  >  Oj  is  a  subsequence  converging  to  K*. 
then  J(K'j)  J  J(K*)  =  JV 

Therefore,  the  infimura  of  J(K)  over  Sg  is  indeed  attained  at  K*  in  Sg.  and  K*  is 
an  optimal  solution  to  the  decentralized  control  problem  posed.  In  other  words,  under 
the  conditions  stated,  J(K)  has  a  minimum  over  Sg 

We  note  that  the  existence  of  a  positive  scalar  s  such  that  Q>  s  C'C  and  W  >  s 
BB'  are  precisely  the  same  kind  of  weighting  matrix  selection  procedures,  ensuring 
low- sensitivity  feedback  controllers  (68]  and  robust  observers  [69].  For  instance,  it  is 
suggested  in  [69],  that  the  system  process  noise  should  be  selected  such  that 

W  =  Wo  +  q2  BVB  (63) 

where  Wo  >  0.  V  >0.  and  q  is  a  non-zero  scalar.  The  matrix  Wfl  is  the  plant  process 
noise  covariance  and  the  second  term  is  the  fictitious  noise  covariance  to  be  added 
for  robustness  Letting  q**s,  V«I,  and  since  Wft  >  0,  we  get  W  >  s  BB'  The  other 
condition  (Q  >  s  C'C)  can  be  similarly  obtained  from  [68]  Hence.  Miese  conditions  are 
not  at  all  constraining  but  rather  good  choices  for  a  robust  controller  design,  at  least 
m  the  centralized  case 


2 


wtmrt  | 


aenetonic  convergence. 


39 


The  existence  conditions  can  be  expressed  in  terns  of  the  subsystem  parameters 
for  ease  of  interpretation. 

Corollary  5  Let  the  fixed  modes  of  (C.A.B)  be  stable,  for  some  s  >  0,  Qj  >  s  C‘ j 

C|  and  W  >  s  Bj  B'.,  1  <  i  <  p.  B'  Q  B  +  R  >  0,  and  C  W  C’  +  V  >  0.  Then  there  is  a 

*0 

K*  in  Sg  such  that 

4(K*)  <  J(K),  for  all  K  in  Sg 

Proof.  Note  that  a;  >  0,  so  that  nin  a(  =  a  >  0. 

Q  =  if  a,  Q,  >  s  if  a.  C  ,  C.  >  s  a  if  C,  C,  *saC'C,ia>  0. 

1-1  1  '  i-i  '  1  '  i-i  '  1 

Similarly,  given  the  above  hypothesis 
W  >  s/p  if^  B,  B‘ |  -  s/p  B  B'  with  s/p  >  0 

Thus,  the  conditions  above  imply  the  hypothesis  of  Theorem  4  So  that  J(K)  has  a 
•0 

minimum  in 

It  should  be  noted  that  the  conditions  given  in  Theorem  4  and  Corollary  5  are 

sufficient  for  the  existence  of  an  optimal  decentralized  control  law.  however,  they  are 

not  necessary  for  the  existence  of  an  optimal  solution.  Also  note  that  the  question  of 
uniqueness  of  the  optima!  •••«  it  unr«»olved. 

It  can  be  seen  that,  for  the  decentralised  control  problem  posed  here,  it  is 
possible  to  find  existence  conditions  which  apply  to  a  large  class  of  optimization 
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problems  We  note  that  the  existence  conditions  include  the  case  of  no  measurement 
noise  (V=0),  provided  that  the  process  noise  W  is  positive  definite,  the  number  of 
measurements  are  less  than  or  equal  to  the  number  of  states,  and  the  measurement 
matrix  C  has  full  rank.  Similarly,  the  case  of  no  control  penalty  (R=0)  is  also 
included  if  the  state  weighting  matrix  Q  is  positive  definite,  the  number  of  controls 
are  less  than  the  number  of  states  and  the  input  transition  matrix  B  has  full  rank 
Moreover,  the  case  of  V=R=0  simultaneously  is  also  included,  provided  that  the 
conditions  above  are  both  satisfied  In  general,  however,  Theorem  4  places  no 
restrictions  on  the  number  of  measurements,  states,  and  controls,  and  on  the  ranks  of 
B  and  C.  Thus,  the  case  of  multiple  measurements  of  the  same  variable  (i.e.  C  does  not 
have  full  rank)  as  it  would  be  expected  in  most  decentralized  control  problems  in 
which  one  measurement  is  available  to  more  than  one  subsystem,  will  have  an  optimal 
stable  solution  if  the  existence  conditions  are  met. 

S  B  Incremental  Cost  and  Necessary  Conditions 

The  necessary  conditions  for  the  constrained  output  feedback  problems  have 
been  previously  explored  [4l]-[42].  These  conditions  have  been  ob  kdiueu  by  casting 
the  problem  in  a  nonlinear  programming  framework  As  the  resulting  necessary 
conditions  are  coupled  nonlinear  matrix  equations,  a  reliable  algorithm  for  obtaining 
their  solution  has  not  been  available 

The  approach  taken  in  our  study  is  based  on  the  incremental  cost.  i.e..  the  total 
change  in  the  cost  due  to  a  change  in  the  gain  The  expression  for  the  incremental 
cost  for  the  responding  decentralized  case  is  presented  below  The  incremental  cost 
expression  is  used  in  obtaining  the  decentralized  control  law  algorithms  in  the  next 


section.  Our  approach  attempts  to  iteratively  reduce  the  cost  in  order  to  locate  a 

minimum,  as  opposed  to  solving  the  nonlinear  matrix  equations  corresponding  to  the 

necessary  conditions.  These  necessary  conditions  also  follow  immediately  from  the 
incremental  cost.  The  expression  for  the  incremental  cost  for  the  unconstrained 
output  feedback  problem  is  derived  in  [66]  and  repeated  below  for  completeness. 

M 

Lemma  10.  Let  K  and  K  =  AK  be  in  S.  Then  the  incremental  cost  is  given  by 
AJ(K.AK)  «  J(K  4  AK)  -  J(K)  =  5  tr)2  AK'  T(K,  AK)| 

4  5  irjAK'  P(K  4  AK)  AK  S(K)|.  (64) 

T(K.AK)  «=  P(K  4  AK)  K  S(K)  -  B  P(K  4  AK)  A  S(K)  C*  (65) 

with 

i(K)  *  C  S(K)  C  4  V  (66) 

where  S(K)  is  the  steady-state  covariance  of  x(k)  given  by 

S(K)  -  A(K)  S(K)  A(K)'  4  B  K  V  K'  B‘  4  W.  (67) 

mt 

The  expression  above  holds  on  S,  hence,  it  hold  on  every  subset,  and  in 
particular  on  the  set  of  block  diagonal  stabilizing  gains  Note  from  (64)  that  T(K. 
0)  is  the  gradient  of  J(K) 

The  incremental  cost  expression  for  the  decentralized  case  is  presented  next; 

Corollary  6  Let  K  and  K  4  AK  be  in  with  AK  block  diagonal,  i  e.. 
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D(r.)  AK  D‘(i»j)  =  0,  i  /  j.  1  <  i.  j  <  p 


ri  =  r.  +  qj  .  Wj  =  »j  +  q. 


D(r,)  =  [0  !(r j)  ...  0] 


where  l(r ,)  is  the  r,  x  r,  identity  matrix.  Then  the  incremental  cost  is  given  by 


AJ(K.  AK)  =  5  if  tr{2  AK',  T.,(K.  AK) 


if^  AK',  Pj j(K  +  AK)  AKj  ij ,(K)|. 


T,,(K.  AK)  *  D(r,)  T(K.  AK)  D'tm,)  . 


?[}(K.  AK)  *  D{r,)  P(K  +  AK)  D'(rj) 


Sj j{K)  -  D(iBj)  S(K)  D  (^) 


Proof  Substituting  the  representation  AK  *  if^  D(r,)  AK,D(a,)  for  AK  in  (64) 


and  using  trace  identities,  we  get  (71). 


Note  that  the  incremental  cost  above  ts  the  exact  change,  not  the  first  order 


variation  The  only  restriction  on  K  and  K  +  AK  is  that  they  meet  the  constraints 


and  stabilize  the  system  From  the  definition  of  variation,  we  have 


W(K.AK)  -  lira  -  (J(K+aAK)  -  J(K)) 
®->0  9 


Substituting  the  expression  for  the  incremental  cost  into  the  definition  above  and 


using  the  continuity  properties  of  J(K)  given  in  Corollary  2.  we  can  easily  obtain  the 
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gradient  and  hence  the  necessary  conditions  which  are  stated  next. 


Lemma  1_1:  J(K)  is  continuously  differentiable  on  the  set  of  block  diagonal 
stabilizing  gains  Sg  and  the  gradient  is  given  by 


3  j 

*—  (K)  =  T..(K.  0)  1  <  i  <  p  and  K  in  SL. 

The  necessary  conditions  for  optimality  are 


(?6) 


Tjj(K*,  0)  =  0  1  <  i  <  p  and  K*  in  Sg. 


(77) 


In  the  next  section,  we  will  present  two  algorithms  for  finding  a  minimal  solution 
based  on  the  optimal  output  feedback  algorithm  solving  the  cost  functional  directly 
through  the  use  of  the  incremental  cost  as  opposed  to  solving  the  necessary 
conditions. 


2.9  Constrained  Output  Feedback  Algorithms 

As  shown  in  the  previous  section,  the  necessary  conditions  for  the  posed 
constrained  optimal  output  feedback  problem  are  a  coupled  set  of  nonlinear  matrix 
equations.  The  solution  of  theae  equations  usually  involves  lengthy  gradient  search 
techniques  in  which  the  computation  of  large  order  Hessian  matrices  are  required. 
Here,  we  will  present  two  algorithms  for  solving  the  constrained  output  feedback 
problem  based  on  the  incremental  cost. 


The  first  constrained  algorithm  called  the  "subsystem  iteration  algorithm"  here  is 
a  straightforward  iterative  application  of  the  unconstrained  output  feedback  algorithm 
(66)  to  each  controller  while  closing  the  loop  on  the  other  controllers.  Ve  have 


chosen  this  subsystem  iteration  algorithm  as  a  benchmark.  The  reasons  for 
considering  this  unconstrained  output  feedback  algorithm  are  as  follows:  1)  First,  its 
convergence  for  the  unconstrained  case  has  been  proven  analytically  under 
realistically  weak  existence  conditions.  2)  Second,  its  speed  of  convergence  is 
considerably  better  than  others  since  it  does  not  involve  lengthy  line  searches. 

The  major  result  of  this  section  is  the  second  constrained  algorithm,  called  the 
"decentralized  control  algorithm"  here,  which  is  a  generalization  of  the  unconstrained 
one  to  constrained  systems  in  which  the  direction  suggested  by  the  constrained 
incremental  cost  given  by  eqs.  (73)-(75)  is  used.  The  cbnvergence  of  this  algorithm  is 
proved  in  Section  2.10.  We  first  present  the  subsystem  iteration  algorithm 


Subsystem  Iteration  Algorithm 


1.  Choose  a  block  diagonal  K0  =  block  diag  }[Koj],  i=l . pj  such  that  A(K0)  is 

stable  and  set  n=l 


II.  Choose  an  index  j  from  jl . pj.  Solve  the  unconstrained  output  feedback 

problem  for  the  system  (A-E  B.K  jC.,Bj,C.)  with  weighting 

matrices  Q-iE^  C j *K0 ’ R j K0 j C .  and  Rj,  process  noise  W+E^  B j K0 ; V } K0 5 ’ B * f 


and  measurement  noise  V.  using  the  algorithm  for  the  unconstrained  optimal 
output  problem  described  in  [65]  with  an  initial  guess  K0J.  to  obtain  set 

Koj  "  V 

III.  Repeat  Step  11  for  all  of  the  other  indices  in  jl . pj  to  obtain  }[Kni], 

1=1.. ...pj. 


IV.  Evaluate  the  incremental  cost  J(Kn)-J(Kf>_1)  given  by  eq.  76  and  the 

gradient  -  (K)  for  i=l . p  given  by  Lemma  11.  Test  for 

3Kni 


convergence  of  the  incremental  cost  and  gradient.  Stop  if  selected 
convergence  criteria  are  satisfied,  otherwise,  set  n=n+l  and  go  to  Step  II. 


As  implied  by  Theorem  4,  when  the  number  of  controls  and  measurements  are 
both  less  than  the  number  of  states.  B  and  C  have  full  rank,  and  Q  and  W  are  positive 
definite,  then  block  output  stabilizabihty  of  (C.A.B)  is  a  sufficient  condition  for  the 
existence  of  a  minimal  stabilizing  gain  in  Step  11  of  the  algorithm  above.  Under  these 
and  the  more  general  conditions  stated  in  Theorem  4,  it  is  easy  to  see  that  }J(Kn)j  is  a 
monotomcally  decreasing  sequence.  Since  the  sequence  is  also  bounded  from  below, 
the  costs  will  converge  to  a  minimum.  Since  the  set  of  block  diagonal  stabilizing  gains 
over  which  the  optimization  is  performed  can  be  an  open  set,  it  needs  further  to  be 
shown  that  the  set  of  block  diagonal  stabilizing  gains  with  a  bounded  cost  is  bounded 
so  that  the  minimum  block  diagonal  gain  is  attained  at  an  interior  point. 
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The  second  algorithm  is  obtained  by  expiating  the  "almost  quadratic"  form  of 
the  incremental  cost  function  for  the  constrained  output  feedback  problem  given  by 
eq  (76).  The  algorithm  is  started  with  a  stabilizing  block  diagonal  gain  KQ  and 
iteratively  produces  a  block  diagonal  gam  sequence  jKn,n=  1 ,2,..|  in  which  the  direction 
d(Kn)=Kn+1-Kn  used  at  each  iteration  is  the  one  suggested  by  the  constrained 
incremental  cost  expression. 

Before  presenting  the  algorithm,  however,  we  will  give  the  following  results  which 
will  insure  the  invertibility  of  a  certain  composite  matrix,  U(K),  at  one  step  of  the 
algorithm  We  also  note  that  the  conditions  guaranteeing  the  invertibility  of  this 
matrix  are  precisely  the  same  ones  dictated  by  the  existence  conditions  in  Theorem  4. 

Lemma  12:  Consider  the  positive  semi-definite  matrices  F(K)  and  S(K),  defined  m 
eqs  (63)  and  (71),  respectively.  If  B'QB  +  R  >  0  and  CWC'  +  V  >  0.  then  P(K)  >  0  and 
S(K)  >  0  for  any  gain  matrix  K. 

Proof.  From  eq.  64.  we  have  P(K)  >  Q  which  implies  B'P(K)B  >  B’QB  So  B'P(K)B 
+  R  >  B'QB  +  R.  Hence.  P(K)  >  B'QB  +  R  >  0  which  implies  F(K)  >  0.  Similarly,  from  eq. 
72,  we  have  S(K)  >  W  which  implies  CS(K)C'  +  V  -  S(K)  >  CWC'  +  V  >  0. 

Lemma  13  Consider  a  positive -definite  matrix  S.  If  S ,  (  is  an  arbitrary  block 
diagonal  partitioning  of  S,  (i.e  S(|  =  D|SD’.(  where  D,  is  defined  by  eq.  42).  then  Sj,  > 
0  for  all  l 


Proof.  Since  x'Sx  >  0  for  all  x,  we  have  x'D,SD',x  >  0  which  implies  S,,  >  0. 


Lemma  14.  Consider  the  symmetric  composite  matrix  U(K)  formed  from  the 


partitions  defined  by 

VK)  -  VK)  »  Sqr(K)  q.r  =  1,2, ...,p  (78) 

where  fi  is  the  direct  product  and  P(K)  and  S(K)  are  defined  by  eqs.  63  and  71.  If, 
B'QB  +  R  >  0  and  CWC'  +  V  >  0.  then  U(K)  is  positive- definite  for  any  matrix  K. 

Proof:  From  Lemma  12.  we  have  P(K)  >  0  and  S(K)  >  0.  Lemma  13  implies  that 

Sjj(K)  >  0  for  i=l,2 . p.  By  Lemma  on  pg.  870  in  [70]  and  by  Lemma  1  in  [2ij.  we 

have  U(K)  >  0 

We  now  present  the  decentralized  control  algorithm  which  is  the  generalization  of 
the  unconstrained  output  feedback  algorithm  to  the  constrained  case. 

Decentralized  Control  Algorithm 

I.  Choose  a  block  diagonal  K0  such  that  A(Kft)  is  stable,  ae  in  [0.1  ].  z>l,  and 
set  n=0 

II.  Solve  the  following  for  S(Kn) 

S(K„)  =  A(Kn)S(Kn)A  (Kn)  +  BK„VK  „B'  4  W 
III  Solve  the  following  for  P(Kn) 

P(Kn)  =  A(K„)P(Kn)A{Kn)  +  CKnRKftC  +  Q 

IV.  Compute  P(Kn).  S(Kn) 

P(Kn)  *=  B  P(Kn)B  +  R 
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sog  =  cs(Kn)r  +  v 


V.  Form  the  symmetric  composite  matrix  U(Kn)  defined  by  eq.  (78)  from  the 
partitions 


VK„>  '  VK">  »  VKn>  . P 

where  fi  is  the  matrix  direct  product.  If  Un  is  not  positive-definite,  go  to 
Step  9. 

VI.  Form  a  column  vector  s(Kfl)  by  storing  the  row  vectors  of  B'P(Kn)A(Kn)S(Kn)C' 
sequentially  and  denote  a  column  gain  vector  kn#w  obtained  similarly  from 
the  rows  of  K  .  Compute  kn#w  and  d(Kn)  from 

U(K„>  k„..  =  s(K„) 

<W„>  - 

VII.  Compute 

Kn*t  -  K.  + 

VIII.  Evaluate  cost  function 

J(Kn)  =  1/2  tr[P(Kn)W+K  BF(Kn)KnV] 

If  n=0  set  n=l.  =  an,  go  to  Step  II. 

If  J(Kn)  is  negative  or  either  of  S(Kn)  or  P(Kn)  is  not  positive  semidefinite,  go 
to  Step  IX.  If  J(Kn)-J(Kn)  is  negative,  go  to  Step  X.  otherwise  go  to  Step  IX. 

IX.  Set  -  «„/*.  K„  =  V,.  d<K„>  -  d<K_,>. 

Compute  =  Kn  +  ond(Kn).  Set  =  an.  n=n+l,  and  go  to  step  II. 

X.  Compute  the  constrained  gradient 

r-  O'.)  -  d,t(k„.o)d,'  i-i . P 

0  n  i 

0  j 

If  norm  of  —  and  JOg-JO^,)  are  less  than  some  convergence 
3Kni 


49 


criterion  stop,  otherwise,  go  to  Step  11. 


In  the  decentralized  control  algorithm  above,  the  objective  is  to  choose  a  large 
positive  initial  a  which  makes  the  algorithm  stable.  Steps  V  and  VIII  check  the  lack  of 
convergence  and  the  necessary  reduction  in  a  is  made  in  Step  IX.  The  equations  in 
Step  11  and  111  can  be  solved  using  the  Bartels -Stewart  algorithm  available  in  control 
software  packages  such  as  ORACLS  [72]. 

In  the  next  section,  we  will  give  our  results  concerning  the  convergence  of  the 
decentralized  control  algorithm  In  the  next  chapter,  we  will  present  simulation 
results  for  a  nontrivial  example  problem,  in  which  both  algorithms  are  used  to 
synthesize  a  coordinated  design  of  a  flight  and  engine  control  subsystem 

2.10  Decentralized  Convergence  Results 

In  this  section,  we  show  that  under  the  existence  conditions  outlined  in  Section 
2.6,  the  decentralized  control  algorithm  given  in  the  previous  section  converges  at 
least  to  a  local  minimum.  Theorem  5  is  the  major  result  of  this  section.  Basically,  it 
is  shown  that  the  decentralized  control  algorithm  produces  a  block  diagonal  stabilizing 
gain  at  each  iteration  and  the  sequence  of  gains  converge  to  a  block  diagonal 
stabilizing  gain,  satisfying  the  necessary  condition  given  m  Section  2.8.  Furthermore, 
it  is  proved  that  the  cost  sequence  corresponding  to  the  gain  sequence  converges 
monotonically  Any  stabilizing  block  diagonal  gain  can  be  used  to  start  the  algorithm. 
Theorem  8  guarantees  that  a  block  diagonal  gam  can  be  found,  such  that,  the 
associated  gradient  can  be  made  as  small  as  possible. 
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Theorem  5  assures  that  the  new  gain  at  each  iteration  of  the  algorithm  will  not 
fall  outside  the  stability  region.  Furthermore,  only  a  single  constant  value  of  the 
parameter  a  is  sufficient  to  obtain  the  convergent  gain  sequence.  Therefore,  it  is  not 
necessary  to  conduct  lengthy  line  searches  at  each  iteration.  Although  the  selection 
of  a  may  require  a  number  of  decreases  in  this  parameter,  Theorem  5  assures  that  a 
value  of  a,  for  which  the  algorithm  is  stable,  will  be  reached  in  a  finite  number  of 
steps 


Lemma  15:  Let  the  existence  conditions  in  Theorem  4  hold.  Then  the  set  So 
defined  by 

S0  =  )K  in  Sg|0  <  J(K)  <  J(Ke)j  (79) 

aw 

is  closed  and  bounded  where  K0  is  an  arbitrary  element  of  Sg. 


Proof:  By  Corollary  3.  S  is  closed.  By  Corollary  4.  it  is  also  bounded. 


Theorem  5:  Let  the  existence  conditions  in  Theorem  4  hold.  Then  there  exists  a 


scalar  b  in  (0.1)  and  K*  in  Sg  such  that 
J(K„)  |  J(K*) 


2  j  3  j 

lim  *-  (KJ  *  —  (K*)  for  i-1.2 . p  (81) 

"“>  3Ki  3*1 

where  the  block  diagonal  gain  sequence  K  =  block  diag  )[K  ,).i*l,2 . pj  is  defined 


K_ j  +  G  d(Kni)  i®  1.2 . P 


for  q  in  (0,b)  and  arbitrary  K0  in  Sb.  The  sequence  {[d(Kn!)],  i=l,2 . p{  is  the  solution 

of 


T“<K")  + jLi 

?ij  <K„i  d(KnJ)  S,,<K„)  =  0 

and  K*  satisfies  the  necessary  conditions  of  optimality. 


(83) 


Proof.  We  will  first  show  that  the  set 


soo  =  iK+Q  K  in  So  and  Q  in  [°  a3( 


(84) 


is  a  subset  of  Sg  for  same  a>0.  Suppose  that  there  is  no  such  a>0.  Then  if  we  can 
construct  a  sequence  aj*0  and  a  sequence  in  S0  such  that 

P  A(K j  +  a;  d(K j ))  >  1  (85) 

a*  mm  0m 

Since  SQ  is  closed  and  bounded  by  Lemma  15  )K;i  has  a  limit  point  Kin  SQ.  Note  that 
under  the  assumed  existence  conditions,  the  matrices  P(K)  and  S(K)  for  K  in  S  B  are 
positive  definite  since 


P(K)  >  B'  B+R>0 


S(K)  >  CWC‘  +  V>0 


(86) 


(87) 


Now  forming  composite  column  vectors,  t(K)  and  d(K).  from  the  rows  of  T(|(K)  and 
d(K,).  i-l,2 p,  eq  (83)  can  be  written  as  a  vector  equation  of  the  form 


t(K)  +  U(K)  d(K)  =  0 
where  U(K)  is  defined  by  eq.  (78). 


(88) 
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By  Lemma  14,  U(K)  is  positive  definite,  so  that  d(K)  exists  and  is  continuous  on 

*0  M 

Sg  Hence,  d(K)  is  continuous  on  the  closed  and  bounded  set  SQ.  Since  p(A(K))  is  also 
continuous,  for  some  subsequence 

Kij  +  aij  d(Kjj)  "“>  K  (89) 

P<A(Kj j)  +  a j j  d(K, j))  ->  p(A(K))  >  1 

«  ^  » •  M 

which  is  a  contradiction  since  K  is  in  SQ.  Therefore,  SC<J  a  subset  of  Sg  for  some 

a  >  0  which  will  be  considered  fixed. 

*0 

Since  S00  is  the  inverse  image  of  a  closed  set.  and  since  d(K)  is  continuous,  it 

follows  then  Sofl  is  closed  and  bounded.  Since  P(K)  is  continuously  differentiable  over 

S„„,  it  can  be  shown  that  for  some  finite  M 
00 

||AP(K,a  d(K))||  <  a  M  j|d(K)||  (90) 

where  K  is  in  S0  and  a  is  in  (o.a). 

Now.  using  the  following  decomposition 

T j  j (K.  AK)  »=  T j  j(K,0)  +  AT,  ,(K,  AK)  (91) 

where  Tj|(K.O)  is  defined  by  eqs.  (69), (78),  i.e. 

Tj  j(K,0)  «  D(7j)|P(K)Ki(K)-B'P(K)AS(K)C  |  D(m,)  (92) 

ATm(K,  AK)  *  D(r ,)|B-  AP(K,  AK)  BKi(K)-B'AP(K,  AK)AS(K)C’|  D  (i^)  (93) 

and  substituting  eq.  (91)  into  eq  (75),  letting  AK,  *  ad(K,),  and  rearranging  terms 


AJ(K.xd(K)}  =  l/2[-a(2-a)  Q(K)  +  o‘  *(K,a)] 


K  in  S  and  a  in  (0,a] 


where 


Q(K)  *  tr|l  d'(Kj)  |  P.,(K)  d(K.)  i: j(K)| 

i«i  i*i  *  *  *  f 


t(K)  =  *- 


trjS^  d'(Kj)  [AT.  .(K,ad(K))  +  A^  (K,ad(K)) 


Now,  eq.  (95)  can  be  written  as 

Q(K)  =  ||P(K)  d(K)  S(K)|12  (97) 

where  P(K)  and  S(K)  are  the  square  roots  of  F(K)  and  S(K),  respectively,  and  where  ||.||2 
is  the  euclidean  matrix  norm  [63].  Since  in  finite  dimensional  vector  spaces,  any  two 
norms  are  equivalent,  it  can  be  shown  from  eqs.  (86), (87), (97)  and  the  definition  of 
norm  for  some  M2>0. 

Q(K)  >M2  ||d(K)||2  >0  for  K  in  SQ  (98) 

where  ||.||  is  an  arbitrary  matrix  norm.  On  the  other  hand,  using  eq.  (90  and  96). 


|*(K,a)|  <  ||d(K)||2  for  K  in  S0 


for  some  finite  M,  It  follows  that 


|t(K.o)|  <  M3  Q(K)  K  in  S, 


(100) 


(0,b].  Substituting  eq.  (100)  into  (94) 


AJ(K.ad(K))  <  1/2  l-a(l-aM3)Q(K)]  (101) 

for  K  in  S0.  Since  Q(K)  >  0  whenever  d(K)#)  and  0  <  a  <  1/M3,  we  have 

AJ(K.ad(K))  <0  for  K  in  S0  (102) 

for  a  in  (O.b].  Equality  holds  if  and  only  if  d(K)=0. 

**  M 

It  follows  that  if  K  is  S0  and  a  is  in  (O.b],  then  K-fad(K)  is  in  SQ.  Tiicrefore,  JK 4 1 

M 

is  a  subset  of  SQ.  Since  J(K,)  is  monotone  and  bounded  from  below,  it  converges  to  a 
limit  point  K*  in  S0.  i.e. 

J(K j )  I  J(K*)  (103) 

From.  eqs.  (98)  and  (101),  we  have 

0  <  M2lld(K|)||2  <  Q(K,)  <  M4AJ(K,,ad(Kj ))  (104) 

for  some  positive  M4  Since  the  cost  increments  must  go  to  zero,  Q(K j )  and  d(K,)  must 
vanish  in  the  limit  Since 

Q(K|)  «  trJE^  2ad‘(K| )  (Tn(K.O)  +  P, J(KM(Kj)5J ,](  (105) 

the  gradient  T,,(K.O)  also  converges  to  zero.  Since  the  gradient  is  continuous,  we 
have  eq.  (81)  and  the  proof  complete. 

In  the  next  chapter,  we  will  present  the  simulation  results  for  the  two 
constrained  output  feedback  algorithms. 
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3.  APPLICATION  TO  AN  AIRCRAFT  INTEGRATED  FLIGHT  AND  ENGINE  CONTROL  PROBLEM 


In  this  section,  we  will  present  simulation  results  for  an  aircraft  problem  in 
which  the  two  constrained  output  feedback  algorithms  of  Section  2.9  are  used  to 
design  integrated  flight  and  engine  control  subsystems.  The  example  system,  taken 
from  [73],  represents  the  combined  dynamics  of  an  airframe  and  propulsion  system  for 
a  typical  twin-engine,  advanced  fighter  aircraft 

3.1  Simulation  and  Algorithm  Comparison  Results 

The  airframe  dynamics  are  the  linearized  aircraft  longitudinal  equations  of 
motion  at  a  specified  flight  condition  and  are  of  the  form 

i0(t)  =  A  A(  x0(t)  +  AA,  x#(t)  +  B  A#  u0(t)  +  B  A,  u.(t)  +  w0(t)  (106) 

ya(t)  «  x0(t)  +  v0(t)  (107) 

where  x0  is  the  five  dimensional  airframe  state  vector  composed  of  the  velocity  v, 

angle  of  attack  a.  pitch  rate  p.  pitch  attitude  G.  and  altitude  h  variables.  u0  is  the 
airframe  control  vector  comprised  of  the  horizontal  stabilizer  6#.  y„  is  the  airframe 
measurement  vector  and  y#  is  engine  measurement4  vector.  The  engine  dynamics  are 
obtained  through  model  reduction  techniques  and  are  of  the  form: 

xf(t)  -  A  Et  xt(t)  UE,  x#(t)  *  B  E#  u#(t)  ♦  w#(t)  (108) 

F#(t)  -  *.(t)  +  vf(t)  (109) 

where  x#  is  the  five -dimensional  engine  state  consisting  of  the  fan  speed  Nl. 


4ln  order  to  treat  the  toee  probien  in  (73).  ectuol  oirfrone  end  engine  aeoeurenente  ore 
not  used.  Of  course,  controllers  using  such  neoourenente  con  he  designed  using  the  nethod 
developed  here. 


t 
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compressor  speed  N2,  augmentor  pressure  P5,  main  burner  fuel  flow  Wf,  and 
compressor  discharge  pressure  P2  variables.  uc  is  the  engine  control  vector  composed 
of  the  commanded  fuel  flow  Wfc,  nozzle  area  A,  inlet  guide  valve  CIW,  rear  compressor 
variable  valve  RCW,  and  compressor  bleed  variables  BLC,  and  y#  is  the  engine 
measurement  vector.  System  matrices  above  are  listed  in  Appendix  C  in  (73). 
Linearization  equilibrium  point  corresponds  to  a  Mach  number  of  0.9,  altitude  of 
13.72  km,  and  thrust  of  12,833  newtons. 


The  objective  of  the  flight  control  subsystem  is  to  improve  longitudinal 
performance  through  coordinated  use  of  interacting  aerodynamic  and  propulsive  forces 
and  moments.  The  performance  index  of  the  flight  control  subsystem  is  of  the  form: 


Ja  «  lim  E  fP'z  (t)  Q0  zfl(t)  +  u  (t)  R0  u0(t)  dt  (110) 

1 1  WO  0  0 

where  za  is  the  flight  control  response  vector  composed  of  velocity,  glide  path  angle, 
and  pitch  rate  variables,  and  is  the  flight  control  vector  composed  of  horizontal 
stabilizer  and  thrust  variables.  The  response  vector  is  a  linear  combination  of  the 
airframe  state  and  control  variables  (73)  At  this  operating  point,  engine  control 
subsystem  objective  is  described  by 

J  «  lim  4-  E  jtfx  (t)  Q  x  (t)  +  u  (t)  R  u  (t)  dt  (111) 

where  xt  and  ua  are  the  engine  state  and  control  variables  defined  by  eqs 
(108)-(  109)  The  weighting  matrices  Q#.  R0.  Q#.  and  Rt  are  given  in  Appendix  C  in  (73) 
The  airframe,  engine  and  subsystem  performance  objectives  have  been  fused  into  one 
single  objective  function  as  done  in  Section  2  6  by 


J  -  c,Jfl  ♦  C2J# 


(112) 


The  values  for  the  scalars  used  are  from  [73).  The  continuous  cost  functional 
has  been  discretized  over  a  sampling  interval  of  0.1  sec  as  done  in  [61]  and  an 
equivalent  sampled-data  quadratic  performance  index  has  been  found.  The  following 
constrained  output  feedback  problem  is  then  posed.  Find  K0*  and  Kt*  minimizing  J 
over  gains  satisfying  the  constraint 

ufl(k)  *  -K0y0<k)  (113) 

u,(k)  =  -K#y,(k)  (114) 

The  controller  constraint  above  corresponds  to  the  controller  structure  used  in 
[73]  as  Strategy  2  We  also  note  that  the  full  state  feedback  controller  optimizing  the 
flight  and  engine  control  cost  functionals  separately  (i.e..  neglecting  the  interaction 
between  the  airframe  and  engine  dynamics)  has  a  very  unsatisfactory  performance  for 
this  problem  (Strategy  1  in  [73])  That  is.  the  interaction  between  the  subsystems  in 
this  example  is  significant  and  its  neglect  leads  to  performance  degradation. 

Figure  2  shows  the  performance  of  the  closed-loop  system  employing  the  full- 
state  continuous  regulator  control  optimizing  the  cost  functional  112.  Eigenvalues  for 
the  closed-loop  system  employing  these  full-state  feedback  gains  are  given  in  Table  1. 

The  control  gain  values  obtained  for  this  optimal  limited-state  (eqs  113-114) 
feedback  problem  using  subsystem  iteration  are  given  in  Table  2  The  corresponding 
closed-loop  system  eigenvalues  can  be  seen  in  Table  4.  In  Figure  3.  the  performance 
results  are  presented  for  the  closed-loop  system  employing  the  optima!  digital 
constrained  control  gains  computed  using  the  subsystem  iteration  algorithm  As  shown 
in  this  figure,  the  flight  control  response  (v.o.q.B.h)  of  the  optimal  integrated  digital 
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constrained  feedback  controller  is  remarkably  close  to  that  of  the  optimal  continuous 
full-state  regulator.  It  is  also  seen  that  the  integrated  design  uses  a  slightly 
different  engine  control  strategy  than  that  of  the  full-state  regulator.  However,  the 
response  of  the  engine  state  variables  (Nl,N2.P5.Wf,P2)  for  the  integrated  design  is 
significantly  better  than  the  results  obtained  with  the  suboptima]  control  Strategy  2  m 
[73],  which  are  given  in  Figure  4.  As  seen  from  the  figure,  the  engine  state  variable 
response  of  the  suboptimal  strategy  is  considerably  degraded  compared  to  the  optimal 
decentralized  (Figure  3)  and  full-state  regulator  (Figure  2)  cases  We  also  note  that 
the  optimal  decentralized  flight  controller  gains  have  lower  values  than  those  used  in 
the  suboptimal  strategy 

The  same  problem  has  also  been  solved  using  the  decentralized  control  law 
algorithm  Table  4  contain:  a  comparison  of  the  two  algorithms.  For  the  same 
stopping  criterion,  decentralized  control  algorithm  was  approximately  three  times 
faster  than  the  subsystem  iteration  algorithm  As  seen  from  Table  4.  the  decentralized 
algorithm  converged  after  51  iterations  with  an  o=0  3  On  the  other  hand,  subsystem 
iteration  algorithm  converged  after  24  first  subsystem  (first  order)  and  127  second 
subsystem  (fourth  order)  iterations  with  o  values  of  0.6  and  0.2.  respectively.  It  is 
interesting  to  note  that  a  lower  value  of  o  was  required  for  the  second  subsystem 
iteration  in  this  algorithm 

The  convergence  results  are  to  be  expected  since  the  decentralized  control 
algorithm  uses  the  direction  (better  than  that  used  by  the  other  algorithm)  suggested 
by  the  incremental  cost  On  the  other  hand,  the  order  of  the  linear  equation  to  be 
solved  in  the  subsystem  iteration  algorithm  will  always  be  lower  than  that  involved  in 


the  decentralized  control  algorithm. 


3.2  A  Note  on  Nonlinear  Decentralized  Control 

As  demonstrated  by  Witsenhausen  [37],  for  decentralized  LQG  problems,  a 
nonlinear  control  can  produce  a  smaller  cost  than  the  optimal  linear  control.  As  the 
formulation  developed  here  restricts  the  optimization  to  linear  implementable 
controllers,  it  is  reasonable  to  ask  whether  a  nonlinear  controller  can  produce 
significantly  better  performance  than  the  optimal  linear  controller  obtained. 

An  approach  to  analyze  this  question  is  to  obtain  a  lower  bound  on  the  optimal 
nonlinear  decentralized  cost.  For  the  purpose  of  this  discussion,  we  disregard  the 
fact  that  a  quadratic  cost  function  does  not  always  express  all  the  design  objectives. 
Thus,  for  LQG  problems,  a  lower  bound  can  be  obtair'd  by  simply  removing  the 
constraint  that  the  controller  have  a  decentralized  structure.  In  other  words,  the 
optimal  full-state  feedback  LQG  controller  minimizes  the  cost  over  both  linear  and 
nonlinear  controllers,  including  decentralized  controllers,  and  is  easily  computable. 
This  optimal  controller  therefore  produces  a  cost  at  least  as  low  as  the  optimal 
nonlinear  decentralized  controller,  thus  providing  the  desired  lower  bound 

In  the  example  considered  here  for  en  integrated  engine  and  flight  path  control, 
the  performance  of  the  implementable,  linear,  decentralized  control  and  that  of  the 
full-state  feedback  LQG  controller  are  almost  the  same.  Both  controllers  simulated 
appear  to  provide  almost  the  same  control  strategies  and  performance.  The 
performance  of  the  optimal  nonlinear  decentralized  controller  is  bounded  below  by  the 
full-state  feedback  controller  and  bounded  above  by  the  linear  decentralized 
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controller  However,  as  the  performance  of  the  linear  decentralized  system  is  so  close 
to  the  optimal  LQG  solution,  the  loss  in  performance  appears  to  be  minimal. 

The  approach  to  this  analysis  is  quite  general.  The  optimal  full-state  feedback 
LQG  controller  can  be  computed  and  simulated,  and  its  performance  compared  to  that 
of  the  optimal  implementable,  linear,  decentralized  controller  obtained  by  the 
formulation  presented  in  this  study.  This  provides  an  indication  on  the  extent  to 
which  a  nonlinear  law  might  improve  performance. 

Whereas,  for  highly  nonlinear  plants,  a  nonlinear  controller  is  likely  to  produce 
better  results.  For  linear  plants  with  reasonable  feedback  vectors,  we  think  that 
linear  feedback  is  likely  to  produce  acceptable  performance  without  resorting  to 
optimal  nonlinear  decentralized  controllers  for  which  efficient  algorithms  are  not 
available.  Thus,  we  think  that  for  linear  plants,  appropriate  selection  of  the  feedback 
vector  and  the  order  of  the  dynamic  compensation  can  often  produce  the  desired 
performance. 
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4.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  coordinated  design  of  control  subsystems  has  been  investigated  in  the 
context  of  the  optimal  stochastic  decentralized  control  problem  for  discrete  systems. 
The  problem  is  formulated  so  that  the  optimal  controller  is  implementable  and  linear, 
has  the  desired  decentralized  structure,  stabilizes  the  closed-loop  system,  and 
produces  a  coordinated  system  where  the  subcontrollers  cooperate  in  the  performance 
of  their  individual  tasks  to  the  extent  possible. 

The  problem  is  posed  as  a  constrained  stochastic  output  feedback  problem, 
where  the  gain  is  constrained  to  be  block  diagonal.  In  this  formulation,  the 
decentralized  controller  is  constrained  to  be  linear,  with  finite  order,  implementable 
dynamic  compensators  acting  as  subcontrollers.  Subsystem  controller  performance 
objectives  are  optimized  over  the  parameters  of  their  fixed  order  linear  dynamic 
structure.  The  notion  of  noninteraction  for  quadratic  cost  functionals  are  introduced, 
and  necessary  and  sufficient  conditions  are  given  ensuring  noninteraction  between 
subsystem  controller  objectives. 

This  formulation  produces  two  further  benefits.  The  first  is  that  the  question  of 
the  existence  of  an  optimal,  implementable,  decentralized  control  law  can  be 
satisfactorily  treated.  Sufficient  conditions  which  guarantee  the  existence  of  an 
optimal  controller  are  obtained.  These  conditions  include  a  large  class  of  optimization 
problems,  and  are  expressed  in  terms  of  the  known  system  and  objective  function 
parameters  so  that  the  existence  of  a  solution  can  be  easily  determined  at  the  outset 
of  the  design  process  The  question  of  uniqueness,  however,  remains  to  be  resolved. 
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The  second  benefit  is  that  the  formulation  leads  to  two  constrained  output 
feedback  algorithms  The  first  of  these  algorithms  called  the  subsystem  iteration 
algorithm  is  an  iterative  application  of  an  unconst:  ained  output  feedback  algorithm. 
The  second  one  called  the  decentralized  control  algorithm,  is  a  generalization  of  this 
unconstrained  algorithm  to  the  decentralized  case  and  is  based  on  the  constrained 
incremental  cost  direction.  It  is  proved  that  the  decentralized  control  algorithm 
converges  to  a  solution  under  the  sufficiency  conditions  ensuring  the  existence  of  an 
optimal  solution 

The  formulation  is  used  to  obtain  an  integrated  design  for  an  aircraft  engine 
control  and  flight  path  control  problem  by  using  the  software  implementation  of  the 
two  algorithms  The  convergence  rate  of  the  decentralized  control  algorithm  for  this 
example  is  shown  to  be  significantly  faster  than  that  of  the  subsystem  iteration 
algorithm  A  linear  simulation  shows  excellent  performance  in  comparison  to  the 
unconstrained  full-state  feedback  LQG  controller.  This  demonstration  is  used  to 
analyze  the  significance  and  necessity  of  nonlinear  decentralized  controllers.  These 
simulation  results,  along  with  the  two  uncooperating  subsystems  example,  show  the 
significant  potential  of  the  coordinated  control  approach  in  minimizing  fuel 
expenditures 

The  following  is  our  list  of  recommendations  for  future  study. 

o  Although  the  conditions  for  the  existence  of  an  optimal  solution  have  been 
found,  the  minimal  restrictions  on  the  system  parameters  assuring  the 
uniqueness  of  the  solution  remain  to  be  resolved.  The  importance  of  the 
uniqueness  result  is  that  the  decentralized  control  law  algorithm  would 
converge  to  the  global  minimum  if  the  solution  is  unique,  since  it  has  been 
established  that  the  algorithm  converges  to  at  least  a  local  minimum. 
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o  The  cost  functionals  used  in  this  study  are  average  quadratic  costs  which, 
therefore,  do  not  depend  on  the  initial  conditions.  While  the  average  cost  is 
adequate  for  quite  a  number  of  control  applications,  it  is  desirable  to 
extend  the  results  to  quadratic  cost  functionals  which  depend  on  initial 
conditions.  This  would  be  especially  important  for  applications  having 
stringent  transient  response  requirements. 

o  The  developed  constrained  output  feedback  algorithms  require  an  initial 
block  stabilizing  gain.  Hence,  it  is  desirable  to  find  an  easy  method  of 
computing  an  initial  gain  under  the  shown  existence  conditions. 

o  It  is  also  of  interest  to  find  the  conditions  on  system  parameters  so  that 
the  constrained  output  feedback  optimization  yields  a  stable  compensator. 

o  Robustness  properties  of  the  developed  decentralized  control  law  algorithms 
need  to  be  investigated. 

o  Finally,  after  the  issues  above  are  resolved,  we  recommend  that  the 
decentralized  control  law  algorithm  be  tested  in  a  comprehensive  integrated 
aircraft  control  design  problem. 
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